[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:44:58 dist-test-slave-0b58 krb5kdc[7630](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:44:58 dist-test-slave-0b58 krb5kdc[7630](info): set up 2 sockets
Aug 06 04:44:58 dist-test-slave-0b58 krb5kdc[7630](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260806 04:44:59.869483 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.004s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:44:59 dist-test-slave-0b58 krb5kdc[7630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:45:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:45:00.054425 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:41837
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:41837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:41837
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:00.387549 7643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:00.387964 7643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:00.388139 7643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:00.395233 7643 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:00.395363 7643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:00.395485 7643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:00.395568 7643 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:00.395646 7643 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:45:00.405392 7643 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:41837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:41837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:41837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:00.406836 7643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:00.408564 7643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:00.422096 7648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:00.422098 7651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:00.422295 7649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:00.425623 7643 server_base.cc:1034] running on GCE node
I20260806 04:45:00.426796 7643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:00.428390 7643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:00.429631 7643 hybrid_clock.cc:648] HybridClock initialized: now 1785991500429568 us; error 47 us; skew 500 ppm
I20260806 04:45:00.430078 7643 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:00 dist-test-slave-0b58 krb5kdc[7630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991500, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:00.433609 7643 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:45:00.435272 7643 webserver.cc:460] Webserver started at http://127.7.113.254:46027/ using document root <none> and password file <none>
I20260806 04:45:00.436058 7643 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:00.436208 7643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:00.436620 7643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:00.440780 7643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "e410af4d0aaf47b880cb660458bc8255"
format_stamp: "Formatted at 2026-08-06 04:45:00 on dist-test-slave-0b58"
server_key: "038a260044a03128e28591811bca25e2"
server_key_iv: "959ff48699e723df81bb4f2284a4a504"
server_key_version: "encryptionkey@0"
I20260806 04:45:00.441874 7643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "e410af4d0aaf47b880cb660458bc8255"
format_stamp: "Formatted at 2026-08-06 04:45:00 on dist-test-slave-0b58"
server_key: "038a260044a03128e28591811bca25e2"
server_key_iv: "959ff48699e723df81bb4f2284a4a504"
server_key_version: "encryptionkey@0"
I20260806 04:45:00.449144 7643 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260806 04:45:00.452980 7658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:00.454398 7643 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:45:00.454589 7643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "e410af4d0aaf47b880cb660458bc8255"
format_stamp: "Formatted at 2026-08-06 04:45:00 on dist-test-slave-0b58"
server_key: "038a260044a03128e28591811bca25e2"
server_key_iv: "959ff48699e723df81bb4f2284a4a504"
server_key_version: "encryptionkey@0"
I20260806 04:45:00.454809 7643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:00.465893 7643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:00.470171 7643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:00.470443 7643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:00.489711 7643 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:41837
I20260806 04:45:00.489732 7710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:41837 every 8 connection(s)
I20260806 04:45:00.491297 7643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:00.495941 7711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:00.501260 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 7643
I20260806 04:45:00.501569 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:00.503459 7623 external_mini_cluster.cc:1428] Setting key 29a00c2a6e8a1b02c8afbbab31e00fc8
I20260806 04:45:00.507638 7711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255: Bootstrap starting.
I20260806 04:45:00.512096 7711 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:00.513342 7711 log.cc:824] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:00.516453 7711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255: No bootstrap required, opened a new log
I20260806 04:45:00.525417 7711 raft_consensus.cc:348] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e410af4d0aaf47b880cb660458bc8255" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41837 } }
I20260806 04:45:00.525789 7711 raft_consensus.cc:374] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:00.525959 7711 raft_consensus.cc:729] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e410af4d0aaf47b880cb660458bc8255, State: Initialized, Role: FOLLOWER
I20260806 04:45:00.526638 7711 consensus_queue.cc:260] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e410af4d0aaf47b880cb660458bc8255" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41837 } }
I20260806 04:45:00.526930 7711 raft_consensus.cc:388] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:00.527113 7711 raft_consensus.cc:482] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:00.527339 7711 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:00.530746 7711 raft_consensus.cc:504] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e410af4d0aaf47b880cb660458bc8255" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41837 } }
I20260806 04:45:00.531471 7711 leader_election.cc:302] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e410af4d0aaf47b880cb660458bc8255; no voters:
I20260806 04:45:00.532234 7711 leader_election.cc:288] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:00.532406 7716 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [term 1 FOLLOWER]: Leader election won for term 1
Aug 06 04:45:00 dist-test-slave-0b58 krb5kdc[7630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:00.533972 7716 raft_consensus.cc:686] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [term 1 LEADER]: Becoming Leader. State: Replica: e410af4d0aaf47b880cb660458bc8255, State: Running, Role: LEADER
I20260806 04:45:00.534451 7716 consensus_queue.cc:237] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e410af4d0aaf47b880cb660458bc8255" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41837 } }
I20260806 04:45:00.534755 7711 sys_catalog.cc:564] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:00.538055 7717 sys_catalog.cc:455] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e410af4d0aaf47b880cb660458bc8255" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e410af4d0aaf47b880cb660458bc8255" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41837 } } }
I20260806 04:45:00.538085 7718 sys_catalog.cc:455] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e410af4d0aaf47b880cb660458bc8255. Latest consensus state: current_term: 1 leader_uuid: "e410af4d0aaf47b880cb660458bc8255" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e410af4d0aaf47b880cb660458bc8255" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41837 } } }
I20260806 04:45:00.538573 7717 sys_catalog.cc:458] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:00.538600 7718 sys_catalog.cc:458] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:00.550798 7722 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:00.552129 7713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:00.507766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36134 (local address 127.7.113.254:41837)
0806 04:45:00.508708 (+ 942us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:00.508720 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:00.510182 (+ 1462us) server_negotiation.cc:407] Connection header received
0806 04:45:00.519166 (+ 8984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:00.519185 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:00.519601 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:00.519989 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:00.522946 (+ 2957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:00.524354 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:00.526038 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:00.526857 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:00.527117 (+ 260us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:00.534847 (+ 7730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:00.534932 (+ 85us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:00.534956 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:00.535002 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:00.542630 (+ 7628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:00.543919 (+ 1289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:00.543948 (+ 29us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:00.543959 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:00.544290 (+ 331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:00.544984 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:00.544991 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:00.544997 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:00.546027 (+ 1030us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:00.546517 (+ 490us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:00.549641 (+ 3124us) server_negotiation.cc:299] Negotiation successful
0806 04:45:00.550125 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":407,"threads_started":1}
I20260806 04:45:00.558143 7722 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:00.568291 7722 catalog_manager.cc:1347] Generated new cluster ID: 1183bc53b919414fb2b7888cb449dccc
I20260806 04:45:00.568423 7722 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:00.575577 7722 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:00.576949 7722 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:00.582959 7722 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e410af4d0aaf47b880cb660458bc8255: Generated new TSK 0
I20260806 04:45:00.583666 7722 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:45:00.636168 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41837
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:41837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:00.962656 7738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:00.962911 7738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:00.963013 7738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:00.970243 7738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:00.970355 7738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:00.970469 7738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:45:00.979959 7738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:41837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41837
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:00.981178 7738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:00.982554 7738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:00.995594 7743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:00.995777 7744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:00.996347 7746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:00.996677 7738 server_base.cc:1034] running on GCE node
I20260806 04:45:00.997370 7738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:00.998265 7738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:00.999485 7738 hybrid_clock.cc:648] HybridClock initialized: now 1785991500999436 us; error 43 us; skew 500 ppm
I20260806 04:45:00.999845 7738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:00 dist-test-slave-0b58 krb5kdc[7630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991500, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:01.003078 7738 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:45:01.004506 7738 webserver.cc:460] Webserver started at http://127.7.113.193:33971/ using document root <none> and password file <none>
I20260806 04:45:01.005159 7738 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:01.005268 7738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:01.005530 7738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:01.008491 7738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "820711974b064bf6ae582a7a1f558437"
format_stamp: "Formatted at 2026-08-06 04:45:01 on dist-test-slave-0b58"
server_key: "1a3e5b14e73a89063200193c37b76394"
server_key_iv: "638006776e0287c75de411925700b8b4"
server_key_version: "encryptionkey@0"
I20260806 04:45:01.009202 7738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "820711974b064bf6ae582a7a1f558437"
format_stamp: "Formatted at 2026-08-06 04:45:01 on dist-test-slave-0b58"
server_key: "1a3e5b14e73a89063200193c37b76394"
server_key_iv: "638006776e0287c75de411925700b8b4"
server_key_version: "encryptionkey@0"
I20260806 04:45:01.014134 7738 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:45:01.017822 7753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:01.019114 7738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260806 04:45:01.019279 7738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "820711974b064bf6ae582a7a1f558437"
format_stamp: "Formatted at 2026-08-06 04:45:01 on dist-test-slave-0b58"
server_key: "1a3e5b14e73a89063200193c37b76394"
server_key_iv: "638006776e0287c75de411925700b8b4"
server_key_version: "encryptionkey@0"
I20260806 04:45:01.019471 7738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:01.046911 7738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:01.050992 7738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:01.051340 7738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:01.052547 7738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:01.053972 7738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:01.054085 7738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:01.054240 7738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:01.054316 7738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:01.087728 7738 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:40905
I20260806 04:45:01.087783 7866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:40905 every 8 connection(s)
I20260806 04:45:01.089157 7738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:45:01.094205 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 7738
I20260806 04:45:01.094460 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:45:01.095273 7623 external_mini_cluster.cc:1428] Setting key 3014713ecd10a32c182a33161d9d49be
Aug 06 04:45:01 dist-test-slave-0b58 krb5kdc[7630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991500, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:01.113337 7869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:01.091907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:42659 (local address 127.7.113.254:41837)
0806 04:45:01.092393 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:01.092398 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:01.093363 (+ 965us) server_negotiation.cc:407] Connection header received
0806 04:45:01.096070 (+ 2707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:01.096077 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:01.096177 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:01.096358 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:01.098225 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:01.099020 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:01.101526 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:01.101927 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:01.102025 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:01.106013 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:01.106022 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:01.106029 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:01.106075 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:01.109723 (+ 3648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:01.110467 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:01.110475 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:01.110481 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:01.110639 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:01.111052 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:01.111059 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:01.111065 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:01.111496 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:01.111659 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:01.112529 (+ 870us) server_negotiation.cc:299] Negotiation successful
0806 04:45:01.112804 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":224,"threads_started":1}
I20260806 04:45:01.113955 7870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:01.092528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41837 (local address 127.7.113.193:42659)
0806 04:45:01.093208 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:01.093245 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:01.095737 (+ 2492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:01.096595 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:01.096604 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:01.097239 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:01.098044 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:01.098072 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:01.099191 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:01.099201 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:01.101382 (+ 2181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:01.101405 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:01.102144 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:01.102154 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:01.102489 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:01.103224 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:01.103259 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:01.105775 (+ 2516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:01.109867 (+ 4092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:01.109874 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:01.109888 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:01.110315 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:01.110739 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:01.110742 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:01.110745 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:01.110929 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:01.111650 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:01.111657 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:01.112086 (+ 429us) client_negotiation.cc:769] Sending connection context
0806 04:45:01.112376 (+ 290us) client_negotiation.cc:240] Negotiation successful
0806 04:45:01.112790 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":264,"threads_started":1}
I20260806 04:45:01.115626 7867 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41837
I20260806 04:45:01.115975 7867 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
I20260806 04:45:01.116839 7867 heartbeater.cc:511] Master 127.7.113.254:41837 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
I20260806 04:45:01.119625 7675 ts_manager.cc:194] Registered new tserver with Master: 820711974b064bf6ae582a7a1f558437 (127.7.113.193:40905)
I20260806 04:45:01.121265 7675 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:42659
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:45:01.143103 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41837
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:41837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:01.469398 7873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:01.469660 7873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:01.469837 7873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:01.476989 7873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:01.477088 7873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:01.477306 7873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:45:01.486788 7873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:41837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41837
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:01.488014 7873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:01.489460 7873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:01.502346 7882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:01.502470 7880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:01.503284 7878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:01.506826 7873 server_base.cc:1034] running on GCE node
I20260806 04:45:01.507393 7873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:01.508358 7873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:01.509565 7873 hybrid_clock.cc:648] HybridClock initialized: now 1785991501509538 us; error 42 us; skew 500 ppm
I20260806 04:45:01.509838 7873 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:01 dist-test-slave-0b58 krb5kdc[7630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991501, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:01.513096 7873 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:45:01.514578 7873 webserver.cc:460] Webserver started at http://127.7.113.194:39411/ using document root <none> and password file <none>
I20260806 04:45:01.515300 7873 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:01.515445 7873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:01.515760 7873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:01.518919 7873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "8b294ec0b8104352900ec617aaf2e9d5"
format_stamp: "Formatted at 2026-08-06 04:45:01 on dist-test-slave-0b58"
server_key: "0a3f6e29a8d0f590b00b1fbb50bced83"
server_key_iv: "de65da7d6f8155723a53dd1a1e0e0000"
server_key_version: "encryptionkey@0"
I20260806 04:45:01.519693 7873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "8b294ec0b8104352900ec617aaf2e9d5"
format_stamp: "Formatted at 2026-08-06 04:45:01 on dist-test-slave-0b58"
server_key: "0a3f6e29a8d0f590b00b1fbb50bced83"
server_key_iv: "de65da7d6f8155723a53dd1a1e0e0000"
server_key_version: "encryptionkey@0"
I20260806 04:45:01.525029 7873 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 04:45:01.528502 7889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:01.529892 7873 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 04:45:01.530076 7873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "8b294ec0b8104352900ec617aaf2e9d5"
format_stamp: "Formatted at 2026-08-06 04:45:01 on dist-test-slave-0b58"
server_key: "0a3f6e29a8d0f590b00b1fbb50bced83"
server_key_iv: "de65da7d6f8155723a53dd1a1e0e0000"
server_key_version: "encryptionkey@0"
I20260806 04:45:01.530285 7873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:01.565629 7873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:01.569554 7873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:01.569852 7873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:01.570910 7873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:01.572284 7873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:01.572415 7873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:01.572577 7873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:01.572664 7873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:01.607295 7873 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:39589
I20260806 04:45:01.607347 8001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:39589 every 8 connection(s)
I20260806 04:45:01.608639 7873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:45:01.610472 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 7873
I20260806 04:45:01.610706 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:45:01.611299 7623 external_mini_cluster.cc:1428] Setting key 2015440382fadfba9a2135917a96c7a9
Aug 06 04:45:01 dist-test-slave-0b58 krb5kdc[7630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991501, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
I20260806 04:45:01.630860 7869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:01.611220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:41275 (local address 127.7.113.254:41837)
0806 04:45:01.611434 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:01.611440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:01.612932 (+ 1492us) server_negotiation.cc:407] Connection header received
0806 04:45:01.614978 (+ 2046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:01.614986 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:01.615083 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:01.615198 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:01.616695 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:01.617834 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:01.619557 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:01.619992 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:01.620088 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:01.624351 (+ 4263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:01.624357 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:01.624362 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:01.624407 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:01.627446 (+ 3039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:01.628246 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:01.628252 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:01.628311 (+ 59us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:01.628446 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:01.628938 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:01.628943 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:01.628948 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:01.629310 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:01.629491 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:01.630241 (+ 750us) server_negotiation.cc:299] Negotiation successful
0806 04:45:01.630490 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 04:45:01.632051 8004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:01.611850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41837 (local address 127.7.113.194:41275)
0806 04:45:01.612751 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:01.612810 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:01.614721 (+ 1911us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:01.615395 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:01.615402 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:01.615899 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:01.616530 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:01.616550 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:01.618023 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:01.618029 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:01.619398 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:01.619417 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:01.620219 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:01.620229 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:01.620613 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:01.621312 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:01.621351 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:01.624075 (+ 2724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:01.627604 (+ 3529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:01.627614 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:01.627631 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:01.628095 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:01.628581 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:01.628586 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:01.628590 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:01.628803 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:01.629452 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:01.629462 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:01.629825 (+ 363us) client_negotiation.cc:769] Sending connection context
0806 04:45:01.630114 (+ 289us) client_negotiation.cc:240] Negotiation successful
0806 04:45:01.630683 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":390,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
I20260806 04:45:01.633808 8002 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41837
I20260806 04:45:01.634179 8002 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:01.635013 8002 heartbeater.cc:511] Master 127.7.113.254:41837 requested a full tablet report, sending...
I20260806 04:45:01.636595 7675 ts_manager.cc:194] Registered new tserver with Master: 8b294ec0b8104352900ec617aaf2e9d5 (127.7.113.194:39589)
I20260806 04:45:01.637399 7675 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:41275
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:45:01.657631 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41837
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:41837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:01.983246 8007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:01.983518 8007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:01.983739 8007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:01.990844 8007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:01.990945 8007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:01.991146 8007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:45:02.000545 8007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:41837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41837
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:02.001777 8007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:02.003126 8007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:02.016034 8013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:02.016065 8015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:02.016208 8012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:02.017129 8007 server_base.cc:1034] running on GCE node
I20260806 04:45:02.017701 8007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:02.018601 8007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:02.019830 8007 hybrid_clock.cc:648] HybridClock initialized: now 1785991502019787 us; error 53 us; skew 500 ppm
I20260806 04:45:02.020149 8007 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:02 dist-test-slave-0b58 krb5kdc[7630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991502, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:02.023350 8007 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:45:02.024952 8007 webserver.cc:460] Webserver started at http://127.7.113.195:39009/ using document root <none> and password file <none>
I20260806 04:45:02.025697 8007 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:02.025856 8007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:02.026221 8007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:02.029151 8007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "5498da7a6c044765bea23e356a9a5fe3"
format_stamp: "Formatted at 2026-08-06 04:45:02 on dist-test-slave-0b58"
server_key: "f38ae293fb3363c4dcde9c854d29f366"
server_key_iv: "7295fb34f220fe76836f39c24377c320"
server_key_version: "encryptionkey@0"
I20260806 04:45:02.029870 8007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "5498da7a6c044765bea23e356a9a5fe3"
format_stamp: "Formatted at 2026-08-06 04:45:02 on dist-test-slave-0b58"
server_key: "f38ae293fb3363c4dcde9c854d29f366"
server_key_iv: "7295fb34f220fe76836f39c24377c320"
server_key_version: "encryptionkey@0"
I20260806 04:45:02.035193 8007 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 04:45:02.038678 8023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:02.039924 8007 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 04:45:02.040092 8007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "5498da7a6c044765bea23e356a9a5fe3"
format_stamp: "Formatted at 2026-08-06 04:45:02 on dist-test-slave-0b58"
server_key: "f38ae293fb3363c4dcde9c854d29f366"
server_key_iv: "7295fb34f220fe76836f39c24377c320"
server_key_version: "encryptionkey@0"
I20260806 04:45:02.040320 8007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:02.056598 8007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:02.061065 8007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:02.061424 8007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:02.062361 8007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:02.063660 8007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:02.063735 8007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:02.063908 8007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:02.063959 8007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:02.101020 8007 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:44889
I20260806 04:45:02.101063 8135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:44889 every 8 connection(s)
I20260806 04:45:02.102300 8007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:45:02.105338 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 8007
I20260806 04:45:02.105561 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:45:02.106208 7623 external_mini_cluster.cc:1428] Setting key d9a0c8b9d11949eef6f4b6af6703d94c
Aug 06 04:45:02 dist-test-slave-0b58 krb5kdc[7630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991502, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:02.123230 7869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:02.104817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:39573 (local address 127.7.113.254:41837)
0806 04:45:02.105022 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:02.105028 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:02.106417 (+ 1389us) server_negotiation.cc:407] Connection header received
0806 04:45:02.109028 (+ 2611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:02.109034 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:02.109157 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:02.109265 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:02.111032 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:02.111776 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:02.113424 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:02.113850 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:02.113985 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:02.117304 (+ 3319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:02.117317 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:02.117321 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:02.117362 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:02.119887 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:02.120838 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:02.120847 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:02.120849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:02.121010 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:02.121463 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:02.121467 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:02.121468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:02.121829 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:02.121963 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:02.122737 (+ 774us) server_negotiation.cc:299] Negotiation successful
0806 04:45:02.122895 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 04:45:02.124203 8138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:02.105312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41837 (local address 127.7.113.195:39573)
0806 04:45:02.106211 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:02.106294 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:02.108769 (+ 2475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:02.109506 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:02.109514 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:02.110263 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:02.110873 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:02.110890 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:02.111962 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:02.111968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:02.113275 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:02.113287 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:02.114071 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:02.114081 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:02.114330 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:02.114951 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:02.114972 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:02.117100 (+ 2128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:02.120027 (+ 2927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:02.120035 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:02.120049 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:02.120702 (+ 653us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:02.121123 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:02.121128 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:02.121132 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:02.121334 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:02.121956 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:02.121965 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:02.122303 (+ 338us) client_negotiation.cc:769] Sending connection context
0806 04:45:02.122651 (+ 348us) client_negotiation.cc:240] Negotiation successful
0806 04:45:02.123021 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":372,"threads_started":1}
I20260806 04:45:02.124455 7867 heartbeater.cc:503] Master 127.7.113.254:41837 was elected leader, sending a full tablet report...
I20260806 04:45:02.126315 8136 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41837
I20260806 04:45:02.126593 8136 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:02.127280 8136 heartbeater.cc:511] Master 127.7.113.254:41837 requested a full tablet report, sending...
I20260806 04:45:02.128681 7674 ts_manager.cc:194] Registered new tserver with Master: 5498da7a6c044765bea23e356a9a5fe3 (127.7.113.195:44889)
I20260806 04:45:02.129474 7674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:39573
I20260806 04:45:02.134653 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 04:45:02 dist-test-slave-0b58 krb5kdc[7630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991502, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 04:45:02 dist-test-slave-0b58 krb5kdc[7630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991502, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:45:02.184580 8143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:02.169165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41180 (local address 127.7.113.193:40905)
0806 04:45:02.169925 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:02.169935 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:02.170196 (+ 261us) server_negotiation.cc:407] Connection header received
0806 04:45:02.170432 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:02.170440 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:02.170658 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:02.170899 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:02.172461 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:02.173473 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:02.174764 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:02.175345 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:02.175484 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:02.179398 (+ 3914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:02.179408 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:02.179421 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:02.179452 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:02.182202 (+ 2750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:02.182821 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:02.182828 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:02.182830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:02.182946 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:02.183246 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:02.183249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:02.183251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:02.183571 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:02.183793 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:02.184016 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 04:45:02.184223 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":365,"threads_started":1}
W20260806 04:45:02.185840 7781 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41180
Aug 06 04:45:02 dist-test-slave-0b58 krb5kdc[7630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 04:45:02 dist-test-slave-0b58 krb5kdc[7630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:45:02.236667 8143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:02.219335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41192 (local address 127.7.113.193:40905)
0806 04:45:02.219679 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:02.219687 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:02.219885 (+ 198us) server_negotiation.cc:407] Connection header received
0806 04:45:02.220059 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:02.220063 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:02.220158 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:02.220316 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:02.221697 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:02.222496 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:02.224725 (+ 2229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:02.225506 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:02.225652 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:02.230968 (+ 5316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:02.230974 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:02.230984 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:02.231015 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:02.233997 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:02.234679 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:02.234683 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:02.234685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:02.234803 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:02.235173 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:02.235178 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:02.235181 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:02.235525 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:02.235766 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:02.236086 (+ 320us) server_negotiation.cc:299] Negotiation successful
0806 04:45:02.236346 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183}
I20260806 04:45:02.238343 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 7738
I20260806 04:45:02.251180 8143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:02.239497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41208 (local address 127.7.113.193:40905)
0806 04:45:02.239707 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:02.239714 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:02.239933 (+ 219us) server_negotiation.cc:407] Connection header received
0806 04:45:02.240116 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:02.240121 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:02.240185 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:02.240308 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:02.241466 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:02.242171 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:02.243442 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:02.243959 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:02.244096 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:02.246352 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:02.246357 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:02.246362 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:02.246402 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:02.248708 (+ 2306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:02.249327 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:02.249335 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:02.249339 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:02.249477 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:02.249829 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:02.249836 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:02.249840 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:02.250091 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:02.250328 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:02.250627 (+ 299us) server_negotiation.cc:299] Negotiation successful
0806 04:45:02.250838 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 04:45:02.251956 7862 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:02.335702 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 7738
I20260806 04:45:02.354352 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 7873
Aug 06 04:45:02 dist-test-slave-0b58 krb5kdc[7630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:45:02.375023 8150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:02.355232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47078 (local address 127.7.113.194:39589)
0806 04:45:02.355691 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:02.355698 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:02.355840 (+ 142us) server_negotiation.cc:407] Connection header received
0806 04:45:02.355981 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:02.355988 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:02.356197 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:02.356406 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:02.357709 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:02.358726 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:02.360037 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:02.360636 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:02.360750 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:02.369507 (+ 8757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:02.369520 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:02.369534 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:02.369567 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:02.372550 (+ 2983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:02.373139 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:02.373145 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:02.373148 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:02.373276 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:02.373631 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:02.373634 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:02.373636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:02.373965 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:02.374181 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:02.374490 (+ 309us) server_negotiation.cc:299] Negotiation successful
0806 04:45:02.374686 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":212,"threads_started":1}
I20260806 04:45:02.376344 7997 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:02.461107 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 7873
I20260806 04:45:02.479005 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 8007
Aug 06 04:45:02 dist-test-slave-0b58 krb5kdc[7630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:45:02.495076 8152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:02.480194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37638 (local address 127.7.113.195:44889)
0806 04:45:02.480891 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:02.480897 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:02.480926 (+ 29us) server_negotiation.cc:407] Connection header received
0806 04:45:02.480984 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:02.480991 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:02.481191 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:02.481320 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:02.482507 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:02.483497 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:02.484809 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:02.485337 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:02.485428 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:02.489576 (+ 4148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:02.489586 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:02.489598 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:02.489627 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:02.492232 (+ 2605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:02.493048 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:02.493056 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:02.493058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:02.493176 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:02.493561 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:02.493565 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:02.493567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:02.493891 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:02.494188 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:02.494488 (+ 300us) server_negotiation.cc:299] Negotiation successful
0806 04:45:02.494743 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":385,"threads_started":1}
I20260806 04:45:02.496361 8131 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:02.578420 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 8007
I20260806 04:45:02.596110 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 7643
I20260806 04:45:02.597319 7706 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:02.698964 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 7643
2026-08-06T04:45:02Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (3939 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:45:02 dist-test-slave-0b58 krb5kdc[8157](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:45:02 dist-test-slave-0b58 krb5kdc[8157](info): set up 2 sockets
Aug 06 04:45:02 dist-test-slave-0b58 krb5kdc[8157](info): commencing operation
krb5kdc: starting...
W20260806 04:45:03.794369 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.000s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:45:03 dist-test-slave-0b58 krb5kdc[8157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:45:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:45:03.987716 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42713
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:42713
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:04.304994 8171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:04.305276 8171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:04.305437 8171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:04.312651 8171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:04.312749 8171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:04.312860 8171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:04.312971 8171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:04.313040 8171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:45:04.322608 8171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:42713
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:04.323853 8171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:04.325230 8171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:04.337122 8176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:04.337184 8177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:04.337087 8179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:04.337935 8171 server_base.cc:1034] running on GCE node
I20260806 04:45:04.338620 8171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:04.339932 8171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:04.341125 8171 hybrid_clock.cc:648] HybridClock initialized: now 1785991504341093 us; error 33 us; skew 500 ppm
I20260806 04:45:04.341414 8171 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:04 dist-test-slave-0b58 krb5kdc[8157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991504, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:04.344635 8171 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:45:04.346072 8171 webserver.cc:460] Webserver started at http://127.7.113.254:35547/ using document root <none> and password file <none>
I20260806 04:45:04.346755 8171 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:04.346889 8171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:04.347219 8171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:04.350023 8171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "dc8afac6a5c54c4e97a6b7ca6093be2d"
format_stamp: "Formatted at 2026-08-06 04:45:04 on dist-test-slave-0b58"
server_key: "cbdbeecb104a3f1883c2085ca25b55b4"
server_key_iv: "0657c3dfe3c115fe744e18af0eb589b1"
server_key_version: "encryptionkey@0"
I20260806 04:45:04.350826 8171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "dc8afac6a5c54c4e97a6b7ca6093be2d"
format_stamp: "Formatted at 2026-08-06 04:45:04 on dist-test-slave-0b58"
server_key: "cbdbeecb104a3f1883c2085ca25b55b4"
server_key_iv: "0657c3dfe3c115fe744e18af0eb589b1"
server_key_version: "encryptionkey@0"
I20260806 04:45:04.355770 8171 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 04:45:04.359025 8186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:04.360181 8171 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 04:45:04.360414 8171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "dc8afac6a5c54c4e97a6b7ca6093be2d"
format_stamp: "Formatted at 2026-08-06 04:45:04 on dist-test-slave-0b58"
server_key: "cbdbeecb104a3f1883c2085ca25b55b4"
server_key_iv: "0657c3dfe3c115fe744e18af0eb589b1"
server_key_version: "encryptionkey@0"
I20260806 04:45:04.360601 8171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:04.378489 8171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:04.382175 8171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:04.382447 8171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:04.400653 8171 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:42713
I20260806 04:45:04.400679 8237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:42713 every 8 connection(s)
I20260806 04:45:04.401973 8171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:04.404119 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 8171
I20260806 04:45:04.404399 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:04.405241 7623 external_mini_cluster.cc:1428] Setting key e1f1c4e13a601532a9e8227688717f9e
I20260806 04:45:04.406277 8238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 04:45:04 dist-test-slave-0b58 krb5kdc[8157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:04.419943 8238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d: Bootstrap starting.
I20260806 04:45:04.423995 8238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:04.425253 8238 log.cc:824] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:04.428526 8238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d: No bootstrap required, opened a new log
I20260806 04:45:04.429047 8241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:04.407245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54040 (local address 127.7.113.254:42713)
0806 04:45:04.408018 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:04.408033 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:04.408080 (+ 47us) server_negotiation.cc:407] Connection header received
0806 04:45:04.409867 (+ 1787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:04.409892 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:04.410365 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:04.410776 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:04.412037 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:04.414161 (+ 2124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:04.415360 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:04.416400 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:04.416595 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:04.420681 (+ 4086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:04.420692 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:04.420709 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:04.420783 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:04.424697 (+ 3914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:04.425435 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:04.425442 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:04.425450 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:04.425645 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:04.426073 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:04.426077 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:04.426079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:04.426613 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:04.426910 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:04.427315 (+ 405us) server_negotiation.cc:299] Negotiation successful
0806 04:45:04.427728 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":321,"threads_started":1}
I20260806 04:45:04.436863 8238 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc8afac6a5c54c4e97a6b7ca6093be2d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42713 } }
I20260806 04:45:04.437187 8238 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:04.437268 8238 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc8afac6a5c54c4e97a6b7ca6093be2d, State: Initialized, Role: FOLLOWER
I20260806 04:45:04.437863 8238 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc8afac6a5c54c4e97a6b7ca6093be2d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42713 } }
I20260806 04:45:04.438112 8238 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:04.438268 8238 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:04.438446 8238 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:04.440469 8238 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc8afac6a5c54c4e97a6b7ca6093be2d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42713 } }
I20260806 04:45:04.440886 8238 leader_election.cc:302] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc8afac6a5c54c4e97a6b7ca6093be2d; no voters:
I20260806 04:45:04.441376 8238 leader_election.cc:288] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:04.441521 8243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:04.442179 8243 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [term 1 LEADER]: Becoming Leader. State: Replica: dc8afac6a5c54c4e97a6b7ca6093be2d, State: Running, Role: LEADER
I20260806 04:45:04.442692 8243 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc8afac6a5c54c4e97a6b7ca6093be2d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42713 } }
I20260806 04:45:04.443352 8238 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:04.445834 8244 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc8afac6a5c54c4e97a6b7ca6093be2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc8afac6a5c54c4e97a6b7ca6093be2d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42713 } } }
I20260806 04:45:04.445750 8245 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc8afac6a5c54c4e97a6b7ca6093be2d. Latest consensus state: current_term: 1 leader_uuid: "dc8afac6a5c54c4e97a6b7ca6093be2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc8afac6a5c54c4e97a6b7ca6093be2d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42713 } } }
I20260806 04:45:04.446278 8245 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:04.446278 8244 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:04.447132 8252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:04.451623 8252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:04.459535 8252 catalog_manager.cc:1347] Generated new cluster ID: eb81f7f8f1e44aa18c57fdd9e46f4f44
I20260806 04:45:04.459641 8252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:04.485517 8252 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:04.486817 8252 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:04.493831 8252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc8afac6a5c54c4e97a6b7ca6093be2d: Generated new TSK 0
I20260806 04:45:04.494585 8252 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:45:04.547755 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42713
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:04.869652 8264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:04.869917 8264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:04.870076 8264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:04.877389 8264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:04.877503 8264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:04.877614 8264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:45:04.887131 8264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42713
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:04.888409 8264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:04.889709 8264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:04.902767 8272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:04.902793 8270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:04.902899 8269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:04.903549 8264 server_base.cc:1034] running on GCE node
I20260806 04:45:04.904188 8264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:04.905110 8264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:04.906311 8264 hybrid_clock.cc:648] HybridClock initialized: now 1785991504906268 us; error 38 us; skew 500 ppm
I20260806 04:45:04.906611 8264 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:04 dist-test-slave-0b58 krb5kdc[8157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991504, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:04.910065 8264 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:45:04.911489 8264 webserver.cc:460] Webserver started at http://127.7.113.193:46727/ using document root <none> and password file <none>
I20260806 04:45:04.912150 8264 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:04.912330 8264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:04.912643 8264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:04.915421 8264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "8cb250fb17fc444c947ce21dd6d9ac43"
format_stamp: "Formatted at 2026-08-06 04:45:04 on dist-test-slave-0b58"
server_key: "e922e99d091d354b241d0bc27d6b2cd7"
server_key_iv: "7a2d2b516c00bdedbc80e5c2fb2b74ab"
server_key_version: "encryptionkey@0"
I20260806 04:45:04.916172 8264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "8cb250fb17fc444c947ce21dd6d9ac43"
format_stamp: "Formatted at 2026-08-06 04:45:04 on dist-test-slave-0b58"
server_key: "e922e99d091d354b241d0bc27d6b2cd7"
server_key_iv: "7a2d2b516c00bdedbc80e5c2fb2b74ab"
server_key_version: "encryptionkey@0"
I20260806 04:45:04.921154 8264 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260806 04:45:04.924435 8279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:04.925729 8264 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:45:04.925892 8264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "8cb250fb17fc444c947ce21dd6d9ac43"
format_stamp: "Formatted at 2026-08-06 04:45:04 on dist-test-slave-0b58"
server_key: "e922e99d091d354b241d0bc27d6b2cd7"
server_key_iv: "7a2d2b516c00bdedbc80e5c2fb2b74ab"
server_key_version: "encryptionkey@0"
I20260806 04:45:04.926090 8264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:04.941594 8264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:04.945988 8264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:04.946305 8264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:04.947373 8264 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:04.948683 8264 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:04.948788 8264 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:04.948930 8264 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:04.949009 8264 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:04.982107 8264 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:32837
I20260806 04:45:04.982154 8392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:32837 every 8 connection(s)
I20260806 04:45:04.983392 8264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:45:04.985055 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 8264
I20260806 04:45:04.985275 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:45:04.986094 7623 external_mini_cluster.cc:1428] Setting key c308c3b723371f610e3721e8574106fd
Aug 06 04:45:04 dist-test-slave-0b58 krb5kdc[8157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991504, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:05.004729 8395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:04.986675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:36253 (local address 127.7.113.254:42713)
0806 04:45:04.987161 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:04.987169 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:04.988202 (+ 1033us) server_negotiation.cc:407] Connection header received
0806 04:45:04.990024 (+ 1822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:04.990032 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:04.990129 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:04.990260 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:04.991636 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:04.992772 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:04.994639 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:04.995025 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:04.995118 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:04.999092 (+ 3974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:04.999096 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:04.999100 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:04.999130 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:05.001647 (+ 2517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:05.002396 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:05.002403 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:05.002408 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:05.002540 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:05.002965 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:05.002971 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:05.002974 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:05.003242 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:05.003399 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:05.004070 (+ 671us) server_negotiation.cc:299] Negotiation successful
0806 04:45:05.004339 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":258,"threads_started":1}
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
I20260806 04:45:05.005755 8396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:04.987244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42713 (local address 127.7.113.193:36253)
0806 04:45:04.988049 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:04.988094 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:04.989765 (+ 1671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:04.990459 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:04.990467 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:04.990932 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:04.991469 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:04.991485 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:04.992909 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:04.992913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:04.994497 (+ 1584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:04.994516 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:04.995240 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:04.995249 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:04.995595 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:04.996294 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:04.996327 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:04.998879 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:05.001825 (+ 2946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:05.001834 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:05.001849 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:05.002274 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:05.002653 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:05.002658 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:05.002661 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:05.002851 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:05.003374 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:05.003382 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:05.003717 (+ 335us) client_negotiation.cc:769] Sending connection context
0806 04:45:05.003997 (+ 280us) client_negotiation.cc:240] Negotiation successful
0806 04:45:05.004575 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":339,"threads_started":1}
I20260806 04:45:05.007351 8393 heartbeater.cc:347] Connected to a master server at 127.7.113.254:42713
I20260806 04:45:05.007658 8393 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
I20260806 04:45:05.008603 8393 heartbeater.cc:511] Master 127.7.113.254:42713 requested a full tablet report, sending...
I20260806 04:45:05.010742 8203 ts_manager.cc:194] Registered new tserver with Master: 8cb250fb17fc444c947ce21dd6d9ac43 (127.7.113.193:32837)
I20260806 04:45:05.012147 8203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:36253
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:45:05.031790 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42713
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:05.348155 8399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:05.348474 8399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:05.348656 8399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:05.355648 8399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:05.355768 8399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:05.355960 8399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:45:05.365377 8399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42713
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:05.366518 8399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:05.367800 8399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:05.380329 8407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:05.380303 8405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:05.380435 8404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:05.381098 8399 server_base.cc:1034] running on GCE node
I20260806 04:45:05.381703 8399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:05.382560 8399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:05.383759 8399 hybrid_clock.cc:648] HybridClock initialized: now 1785991505383717 us; error 30 us; skew 500 ppm
I20260806 04:45:05.384115 8399 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:05 dist-test-slave-0b58 krb5kdc[8157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991505, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:05.387358 8399 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:45:05.388715 8399 webserver.cc:460] Webserver started at http://127.7.113.194:43227/ using document root <none> and password file <none>
I20260806 04:45:05.389348 8399 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:05.389443 8399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:05.389678 8399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:05.392428 8399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "570314a6c2ff49d483fbdf024369e3e1"
format_stamp: "Formatted at 2026-08-06 04:45:05 on dist-test-slave-0b58"
server_key: "16c6ef0536f0eb2039c65fffda49f101"
server_key_iv: "0cdf26b297eb2fbf33a844c2376b13ba"
server_key_version: "encryptionkey@0"
I20260806 04:45:05.393146 8399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "570314a6c2ff49d483fbdf024369e3e1"
format_stamp: "Formatted at 2026-08-06 04:45:05 on dist-test-slave-0b58"
server_key: "16c6ef0536f0eb2039c65fffda49f101"
server_key_iv: "0cdf26b297eb2fbf33a844c2376b13ba"
server_key_version: "encryptionkey@0"
I20260806 04:45:05.397882 8399 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 04:45:05.401831 8414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:05.403570 8399 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 04:45:05.403750 8399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "570314a6c2ff49d483fbdf024369e3e1"
format_stamp: "Formatted at 2026-08-06 04:45:05 on dist-test-slave-0b58"
server_key: "16c6ef0536f0eb2039c65fffda49f101"
server_key_iv: "0cdf26b297eb2fbf33a844c2376b13ba"
server_key_version: "encryptionkey@0"
I20260806 04:45:05.403944 8399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:05.428411 8399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:05.432631 8399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:05.432930 8399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:05.433897 8399 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:05.435168 8399 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:05.435240 8399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:05.435432 8399 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:05.435483 8399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:05.475090 8399 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:45327
I20260806 04:45:05.475183 8528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:45327 every 8 connection(s)
I20260806 04:45:05.476444 8399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:45:05.479764 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 8399
I20260806 04:45:05.479972 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:45:05.480545 7623 external_mini_cluster.cc:1428] Setting key 3cecc52f1cdac10a13ec75d5f063db2b
Aug 06 04:45:05 dist-test-slave-0b58 krb5kdc[8157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991505, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:05.498375 8395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:05.478827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:44029 (local address 127.7.113.254:42713)
0806 04:45:05.479000 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:05.479005 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:05.480242 (+ 1237us) server_negotiation.cc:407] Connection header received
0806 04:45:05.482678 (+ 2436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:05.482684 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:05.482763 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:05.482877 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:05.484247 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:05.485495 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:05.487001 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:05.487709 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:05.487860 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:05.491644 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:05.491654 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:05.491661 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:05.491706 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:05.495389 (+ 3683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:05.496053 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:05.496062 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:05.496068 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:05.496229 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:05.496657 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:05.496665 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:05.496671 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:05.497038 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:05.497190 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:05.497790 (+ 600us) server_negotiation.cc:299] Negotiation successful
0806 04:45:05.498017 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 04:45:05.499269 8531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:05.479213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42713 (local address 127.7.113.194:44029)
0806 04:45:05.480071 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:05.480117 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:05.482392 (+ 2275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:05.483059 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:05.483066 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:05.483533 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:05.484072 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:05.484089 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:05.485643 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:05.485647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:05.486856 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:05.486868 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:05.487906 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:05.487911 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:05.488096 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:05.488842 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:05.488889 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:05.491416 (+ 2527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:05.495529 (+ 4113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:05.495534 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:05.495544 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:05.495935 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:05.496376 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:05.496379 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:05.496381 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:05.496543 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:05.497179 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:05.497184 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:05.497443 (+ 259us) client_negotiation.cc:769] Sending connection context
0806 04:45:05.497687 (+ 244us) client_negotiation.cc:240] Negotiation successful
0806 04:45:05.498198 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":321,"threads_started":1}
I20260806 04:45:05.500659 8529 heartbeater.cc:347] Connected to a master server at 127.7.113.254:42713
I20260806 04:45:05.500950 8529 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
I20260806 04:45:05.501610 8529 heartbeater.cc:511] Master 127.7.113.254:42713 requested a full tablet report, sending...
I20260806 04:45:05.503073 8203 ts_manager.cc:194] Registered new tserver with Master: 570314a6c2ff49d483fbdf024369e3e1 (127.7.113.194:45327)
I20260806 04:45:05.503820 8203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:44029
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:45:05.529762 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42713
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:05.847205 8534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:05.847478 8534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:05.847674 8534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:05.855238 8534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:05.855352 8534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:05.855583 8534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:45:05.865684 8534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42713
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:05.866957 8534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:05.868350 8534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:05.881268 8539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:05.881644 8542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:05.881675 8540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:05.882604 8534 server_base.cc:1034] running on GCE node
I20260806 04:45:05.883185 8534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:05.884053 8534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:05.885274 8534 hybrid_clock.cc:648] HybridClock initialized: now 1785991505885215 us; error 69 us; skew 500 ppm
I20260806 04:45:05.885588 8534 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:05 dist-test-slave-0b58 krb5kdc[8157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991505, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:05.888675 8534 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:45:05.890009 8534 webserver.cc:460] Webserver started at http://127.7.113.195:37575/ using document root <none> and password file <none>
I20260806 04:45:05.890751 8534 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:05.890913 8534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:05.891237 8534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:05.894052 8534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "1a4b6984ca094ae5b3a2fbb2b9760298"
format_stamp: "Formatted at 2026-08-06 04:45:05 on dist-test-slave-0b58"
server_key: "032500e90e9279728e8eaac952d678aa"
server_key_iv: "343d4d07b6fbf6f6d85466df64446c5a"
server_key_version: "encryptionkey@0"
I20260806 04:45:05.894838 8534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "1a4b6984ca094ae5b3a2fbb2b9760298"
format_stamp: "Formatted at 2026-08-06 04:45:05 on dist-test-slave-0b58"
server_key: "032500e90e9279728e8eaac952d678aa"
server_key_iv: "343d4d07b6fbf6f6d85466df64446c5a"
server_key_version: "encryptionkey@0"
I20260806 04:45:05.899904 8534 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 04:45:05.903483 8550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:05.904748 8534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:45:05.904925 8534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "1a4b6984ca094ae5b3a2fbb2b9760298"
format_stamp: "Formatted at 2026-08-06 04:45:05 on dist-test-slave-0b58"
server_key: "032500e90e9279728e8eaac952d678aa"
server_key_iv: "343d4d07b6fbf6f6d85466df64446c5a"
server_key_version: "encryptionkey@0"
I20260806 04:45:05.905129 8534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:05.933982 8534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:05.937975 8534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:05.938287 8534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:05.939294 8534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:05.940685 8534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:05.940790 8534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:05.940948 8534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:05.941030 8534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:05.975742 8534 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:40163
I20260806 04:45:05.975781 8663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:40163 every 8 connection(s)
I20260806 04:45:05.976991 8534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:45:05.986919 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 8534
I20260806 04:45:05.987119 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:45:05.987541 7623 external_mini_cluster.cc:1428] Setting key 290f2ac324b85358a4a480e378fc5280
Aug 06 04:45:05 dist-test-slave-0b58 krb5kdc[8157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991505, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:05.995997 8395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:05.979328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:57085 (local address 127.7.113.254:42713)
0806 04:45:05.979542 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:05.979549 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:05.980653 (+ 1104us) server_negotiation.cc:407] Connection header received
0806 04:45:05.982425 (+ 1772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:05.982432 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:05.982525 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:05.982638 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:05.984008 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:05.985157 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:05.986720 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:05.987213 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:05.987355 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:05.991156 (+ 3801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:05.991160 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:05.991164 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:05.991193 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:05.993566 (+ 2373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:05.994183 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:05.994187 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:05.994189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:05.994308 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:05.994661 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:05.994664 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:05.994666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:05.994919 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:05.995027 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:05.995590 (+ 563us) server_negotiation.cc:299] Negotiation successful
0806 04:45:05.995742 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 04:45:05.996892 8666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:05.979796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42713 (local address 127.7.113.195:57085)
0806 04:45:05.980498 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:05.980540 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:05.982148 (+ 1608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:05.982840 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:05.982848 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:05.983306 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:05.983836 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:05.983854 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:05.985352 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:05.985355 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:05.986571 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:05.986582 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:05.987457 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:05.987465 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:05.987756 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:05.988398 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:05.988419 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:05.990973 (+ 2554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:05.993696 (+ 2723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:05.993702 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:05.993712 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:05.994087 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:05.994400 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:05.994404 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:05.994407 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:05.994572 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:05.995020 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:05.995025 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:05.995294 (+ 269us) client_negotiation.cc:769] Sending connection context
0806 04:45:05.995504 (+ 210us) client_negotiation.cc:240] Negotiation successful
0806 04:45:05.995858 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":283,"threads_started":1}
I20260806 04:45:05.998250 8664 heartbeater.cc:347] Connected to a master server at 127.7.113.254:42713
I20260806 04:45:05.998549 8664 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:05.999220 8664 heartbeater.cc:511] Master 127.7.113.254:42713 requested a full tablet report, sending...
I20260806 04:45:06.000602 8203 ts_manager.cc:194] Registered new tserver with Master: 1a4b6984ca094ae5b3a2fbb2b9760298 (127.7.113.195:40163)
I20260806 04:45:06.001657 8203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:57085
I20260806 04:45:06.002918 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:45:06.015425 8393 heartbeater.cc:503] Master 127.7.113.254:42713 was elected leader, sending a full tablet report...
I20260806 04:45:06.022686 8395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.009531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54052 (local address 127.7.113.254:42713)
0806 04:45:06.009691 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:06.009695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:06.010226 (+ 531us) server_negotiation.cc:407] Connection header received
0806 04:45:06.010420 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:06.010427 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:06.010488 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:06.010591 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:06.012056 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.012915 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.014219 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.014641 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.014782 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.017700 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:06.017705 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:06.017708 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:06.017737 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:06.020058 (+ 2321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:06.020742 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:06.020749 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:06.020752 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:06.020886 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:06.021264 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:06.021269 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:06.021273 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:06.021568 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:06.021818 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:06.022183 (+ 365us) server_negotiation.cc:299] Negotiation successful
0806 04:45:06.022404 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 04:45:06.029191 8203 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54052:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:45:06.036339 8203 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:45:06.059515 8677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.049341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:45327 (local address 127.0.0.1:44590)
0806 04:45:06.050245 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:06.050283 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:06.050543 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:06.051303 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:06.051312 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:06.051345 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:06.051775 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:06.051794 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.053972 (+ 2178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.053977 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:06.056451 (+ 2474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:06.056467 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.058590 (+ 2123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.058596 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:06.058798 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.058848 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 04:45:06.058968 (+ 120us) client_negotiation.cc:240] Negotiation successful
0806 04:45:06.059138 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"thread_start_us":961,"threads_started":1}
I20260806 04:45:06.060220 8678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.049651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44590 (local address 127.7.113.194:45327)
0806 04:45:06.050222 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:06.050231 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:06.050555 (+ 324us) server_negotiation.cc:407] Connection header received
0806 04:45:06.050788 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:06.050796 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:06.051063 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:06.051270 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:06.051991 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.053805 (+ 1814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.056647 (+ 2842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.058113 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.058253 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.058470 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:06.059754 (+ 1284us) server_negotiation.cc:299] Negotiation successful
0806 04:45:06.059917 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":316,"threads_started":1}
I20260806 04:45:06.061295 8679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.051098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:32837 (local address 127.0.0.1:34416)
0806 04:45:06.052441 (+ 1343us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:06.052458 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:06.052573 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:06.053468 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:06.053475 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:06.053498 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:06.053952 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:06.053964 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.055995 (+ 2031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.056006 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:06.058161 (+ 2155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:06.058178 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.060524 (+ 2346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.060530 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:06.060735 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.060794 (+ 59us) client_negotiation.cc:769] Sending connection context
0806 04:45:06.060862 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 04:45:06.060994 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1226,"thread_start_us":1080,"threads_started":1}
I20260806 04:45:06.062153 8680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.051445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34416 (local address 127.7.113.193:32837)
0806 04:45:06.052245 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:06.052272 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:06.052692 (+ 420us) server_negotiation.cc:407] Connection header received
0806 04:45:06.052806 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:06.052813 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:06.053042 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:06.053220 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:06.054167 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.055833 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.058333 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.059972 (+ 1639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.060102 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.061680 (+ 1578us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:06.061750 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 04:45:06.061901 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":414,"threads_started":1}
I20260806 04:45:06.068555 8677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.052561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:40163 (local address 127.0.0.1:48010)
0806 04:45:06.060596 (+ 8035us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:06.060618 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:06.060711 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:06.063520 (+ 2809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:06.063524 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:06.063549 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:06.063735 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:06.063747 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.065297 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.065302 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:06.066637 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:06.066649 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.067804 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.067812 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:06.067992 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.068022 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 04:45:06.068119 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 04:45:06.068243 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7932,"thread_start_us":11970,"threads_started":1}
I20260806 04:45:06.068892 8682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.052998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48010 (local address 127.7.113.195:40163)
0806 04:45:06.062968 (+ 9970us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:06.062974 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:06.062999 (+ 25us) server_negotiation.cc:407] Connection header received
0806 04:45:06.063073 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:06.063078 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:06.063337 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:06.063538 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:06.063904 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.065144 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.066792 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.067647 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.067744 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.067954 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:06.068185 (+ 231us) server_negotiation.cc:299] Negotiation successful
0806 04:45:06.068378 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9812,"thread_start_us":9645,"threads_started":1}
I20260806 04:45:06.068465 8462 tablet_service.cc:1467] Processing CreateTablet for tablet 2febef3b892c4d11ae1a8d0878ec5a15 (DEFAULT_TABLE table=test-table [id=b8b6a02034174894948c3c4e94028e53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:06.070019 8462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2febef3b892c4d11ae1a8d0878ec5a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:06.070384 8328 tablet_service.cc:1467] Processing CreateTablet for tablet 2febef3b892c4d11ae1a8d0878ec5a15 (DEFAULT_TABLE table=test-table [id=b8b6a02034174894948c3c4e94028e53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:06.071468 8328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2febef3b892c4d11ae1a8d0878ec5a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:06.072242 8599 tablet_service.cc:1467] Processing CreateTablet for tablet 2febef3b892c4d11ae1a8d0878ec5a15 (DEFAULT_TABLE table=test-table [id=b8b6a02034174894948c3c4e94028e53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:06.073621 8599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2febef3b892c4d11ae1a8d0878ec5a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:06.082803 8683 tablet_bootstrap.cc:492] T 2febef3b892c4d11ae1a8d0878ec5a15 P 8cb250fb17fc444c947ce21dd6d9ac43: Bootstrap starting.
I20260806 04:45:06.084901 8684 tablet_bootstrap.cc:492] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1: Bootstrap starting.
I20260806 04:45:06.086742 8683 tablet_bootstrap.cc:654] T 2febef3b892c4d11ae1a8d0878ec5a15 P 8cb250fb17fc444c947ce21dd6d9ac43: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:06.087404 8685 tablet_bootstrap.cc:492] T 2febef3b892c4d11ae1a8d0878ec5a15 P 1a4b6984ca094ae5b3a2fbb2b9760298: Bootstrap starting.
I20260806 04:45:06.088660 8684 tablet_bootstrap.cc:654] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:06.088956 8683 log.cc:824] T 2febef3b892c4d11ae1a8d0878ec5a15 P 8cb250fb17fc444c947ce21dd6d9ac43: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:06.089988 8684 log.cc:824] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:06.090804 8685 tablet_bootstrap.cc:654] T 2febef3b892c4d11ae1a8d0878ec5a15 P 1a4b6984ca094ae5b3a2fbb2b9760298: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:06.091744 8685 log.cc:824] T 2febef3b892c4d11ae1a8d0878ec5a15 P 1a4b6984ca094ae5b3a2fbb2b9760298: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:06.092819 8683 tablet_bootstrap.cc:492] T 2febef3b892c4d11ae1a8d0878ec5a15 P 8cb250fb17fc444c947ce21dd6d9ac43: No bootstrap required, opened a new log
I20260806 04:45:06.093170 8683 ts_tablet_manager.cc:1397] T 2febef3b892c4d11ae1a8d0878ec5a15 P 8cb250fb17fc444c947ce21dd6d9ac43: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.006s
I20260806 04:45:06.094499 8684 tablet_bootstrap.cc:492] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1: No bootstrap required, opened a new log
I20260806 04:45:06.094753 8685 tablet_bootstrap.cc:492] T 2febef3b892c4d11ae1a8d0878ec5a15 P 1a4b6984ca094ae5b3a2fbb2b9760298: No bootstrap required, opened a new log
I20260806 04:45:06.094761 8684 ts_tablet_manager.cc:1397] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260806 04:45:06.094996 8685 ts_tablet_manager.cc:1397] T 2febef3b892c4d11ae1a8d0878ec5a15 P 1a4b6984ca094ae5b3a2fbb2b9760298: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 04:45:06.102439 8684 raft_consensus.cc:348] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570314a6c2ff49d483fbdf024369e3e1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45327 } } peers { permanent_uuid: "8cb250fb17fc444c947ce21dd6d9ac43" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 32837 } } peers { permanent_uuid: "1a4b6984ca094ae5b3a2fbb2b9760298" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 40163 } }
I20260806 04:45:06.102820 8684 raft_consensus.cc:374] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:06.102933 8684 raft_consensus.cc:729] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 570314a6c2ff49d483fbdf024369e3e1, State: Initialized, Role: FOLLOWER
I20260806 04:45:06.103569 8684 consensus_queue.cc:260] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570314a6c2ff49d483fbdf024369e3e1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45327 } } peers { permanent_uuid: "8cb250fb17fc444c947ce21dd6d9ac43" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 32837 } } peers { permanent_uuid: "1a4b6984ca094ae5b3a2fbb2b9760298" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 40163 } }
I20260806 04:45:06.104079 8683 raft_consensus.cc:348] T 2febef3b892c4d11ae1a8d0878ec5a15 P 8cb250fb17fc444c947ce21dd6d9ac43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570314a6c2ff49d483fbdf024369e3e1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45327 } } peers { permanent_uuid: "8cb250fb17fc444c947ce21dd6d9ac43" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 32837 } } peers { permanent_uuid: "1a4b6984ca094ae5b3a2fbb2b9760298" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 40163 } }
I20260806 04:45:06.104574 8683 raft_consensus.cc:374] T 2febef3b892c4d11ae1a8d0878ec5a15 P 8cb250fb17fc444c947ce21dd6d9ac43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:06.104712 8683 raft_consensus.cc:729] T 2febef3b892c4d11ae1a8d0878ec5a15 P 8cb250fb17fc444c947ce21dd6d9ac43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cb250fb17fc444c947ce21dd6d9ac43, State: Initialized, Role: FOLLOWER
I20260806 04:45:06.104795 8529 heartbeater.cc:503] Master 127.7.113.254:42713 was elected leader, sending a full tablet report...
I20260806 04:45:06.105422 8683 consensus_queue.cc:260] T 2febef3b892c4d11ae1a8d0878ec5a15 P 8cb250fb17fc444c947ce21dd6d9ac43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570314a6c2ff49d483fbdf024369e3e1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45327 } } peers { permanent_uuid: "8cb250fb17fc444c947ce21dd6d9ac43" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 32837 } } peers { permanent_uuid: "1a4b6984ca094ae5b3a2fbb2b9760298" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 40163 } }
I20260806 04:45:06.105630 8684 ts_tablet_manager.cc:1428] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260806 04:45:06.105597 8685 raft_consensus.cc:348] T 2febef3b892c4d11ae1a8d0878ec5a15 P 1a4b6984ca094ae5b3a2fbb2b9760298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570314a6c2ff49d483fbdf024369e3e1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45327 } } peers { permanent_uuid: "8cb250fb17fc444c947ce21dd6d9ac43" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 32837 } } peers { permanent_uuid: "1a4b6984ca094ae5b3a2fbb2b9760298" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 40163 } }
I20260806 04:45:06.106033 8685 raft_consensus.cc:374] T 2febef3b892c4d11ae1a8d0878ec5a15 P 1a4b6984ca094ae5b3a2fbb2b9760298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:06.106160 8685 raft_consensus.cc:729] T 2febef3b892c4d11ae1a8d0878ec5a15 P 1a4b6984ca094ae5b3a2fbb2b9760298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4b6984ca094ae5b3a2fbb2b9760298, State: Initialized, Role: FOLLOWER
I20260806 04:45:06.106769 8685 consensus_queue.cc:260] T 2febef3b892c4d11ae1a8d0878ec5a15 P 1a4b6984ca094ae5b3a2fbb2b9760298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570314a6c2ff49d483fbdf024369e3e1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45327 } } peers { permanent_uuid: "8cb250fb17fc444c947ce21dd6d9ac43" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 32837 } } peers { permanent_uuid: "1a4b6984ca094ae5b3a2fbb2b9760298" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 40163 } }
I20260806 04:45:06.107714 8683 ts_tablet_manager.cc:1428] T 2febef3b892c4d11ae1a8d0878ec5a15 P 8cb250fb17fc444c947ce21dd6d9ac43: Time spent starting tablet: real 0.014s user 0.012s sys 0.003s
I20260806 04:45:06.107975 8664 heartbeater.cc:503] Master 127.7.113.254:42713 was elected leader, sending a full tablet report...
I20260806 04:45:06.108551 8685 ts_tablet_manager.cc:1428] T 2febef3b892c4d11ae1a8d0878ec5a15 P 1a4b6984ca094ae5b3a2fbb2b9760298: Time spent starting tablet: real 0.013s user 0.015s sys 0.000s
W20260806 04:45:06.228645 8530 tablet.cc:2369] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:45:06.228672 8665 tablet.cc:2369] T 2febef3b892c4d11ae1a8d0878ec5a15 P 1a4b6984ca094ae5b3a2fbb2b9760298: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:45:06.235706 8394 tablet.cc:2369] T 2febef3b892c4d11ae1a8d0878ec5a15 P 8cb250fb17fc444c947ce21dd6d9ac43: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:45:06.285972 8689 raft_consensus.cc:482] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:06.286443 8689 raft_consensus.cc:504] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570314a6c2ff49d483fbdf024369e3e1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45327 } } peers { permanent_uuid: "8cb250fb17fc444c947ce21dd6d9ac43" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 32837 } } peers { permanent_uuid: "1a4b6984ca094ae5b3a2fbb2b9760298" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 40163 } }
I20260806 04:45:06.288079 8689 leader_election.cc:288] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cb250fb17fc444c947ce21dd6d9ac43 (127.7.113.193:32837), 1a4b6984ca094ae5b3a2fbb2b9760298 (127.7.113.195:40163)
I20260806 04:45:06.295285 8692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.288481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:32837 (local address 127.7.113.194:38369)
0806 04:45:06.289109 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:06.289159 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:06.289320 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:06.289767 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:06.289770 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:06.289801 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:06.290211 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:06.290224 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.291442 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.291448 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:06.293208 (+ 1760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:06.293221 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.294522 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.294529 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:06.294717 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.294764 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 04:45:06.294852 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 04:45:06.294991 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":378,"threads_started":1}
I20260806 04:45:06.295316 8680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.288559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:38369 (local address 127.7.113.193:32837)
0806 04:45:06.288827 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:06.288837 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:06.289265 (+ 428us) server_negotiation.cc:407] Connection header received
0806 04:45:06.289479 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:06.289487 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:06.289578 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:06.289673 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:06.290359 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.291316 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.293364 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.294304 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.294425 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.294477 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:06.294898 (+ 421us) server_negotiation.cc:299] Negotiation successful
0806 04:45:06.295033 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 04:45:06.295758 8682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.289455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:54923 (local address 127.7.113.195:40163)
0806 04:45:06.289666 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:06.289671 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:06.289997 (+ 326us) server_negotiation.cc:407] Connection header received
0806 04:45:06.290122 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:06.290129 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:06.290212 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:06.290322 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:06.290957 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.291887 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.293833 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.294736 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.294912 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.294981 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:06.295382 (+ 401us) server_negotiation.cc:299] Negotiation successful
0806 04:45:06.295533 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 04:45:06.295778 8693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.289179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:40163 (local address 127.7.113.194:54923)
0806 04:45:06.289890 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:06.289903 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:06.290005 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:06.290351 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:06.290355 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:06.290397 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:06.290770 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:06.290782 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.292039 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.292044 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:06.293660 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:06.293674 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.294981 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.294988 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:06.295190 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.295222 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 04:45:06.295332 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 04:45:06.295461 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":406,"threads_started":1}
I20260806 04:45:06.296645 8619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2febef3b892c4d11ae1a8d0878ec5a15" candidate_uuid: "570314a6c2ff49d483fbdf024369e3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4b6984ca094ae5b3a2fbb2b9760298" is_pre_election: true
I20260806 04:45:06.296671 8348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2febef3b892c4d11ae1a8d0878ec5a15" candidate_uuid: "570314a6c2ff49d483fbdf024369e3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cb250fb17fc444c947ce21dd6d9ac43" is_pre_election: true
I20260806 04:45:06.297148 8619 raft_consensus.cc:2454] T 2febef3b892c4d11ae1a8d0878ec5a15 P 1a4b6984ca094ae5b3a2fbb2b9760298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570314a6c2ff49d483fbdf024369e3e1 in term 0.
I20260806 04:45:06.297163 8348 raft_consensus.cc:2454] T 2febef3b892c4d11ae1a8d0878ec5a15 P 8cb250fb17fc444c947ce21dd6d9ac43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570314a6c2ff49d483fbdf024369e3e1 in term 0.
I20260806 04:45:06.297840 8418 leader_election.cc:302] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4b6984ca094ae5b3a2fbb2b9760298, 570314a6c2ff49d483fbdf024369e3e1; no voters:
I20260806 04:45:06.298171 8689 raft_consensus.cc:2781] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:45:06.298337 8689 raft_consensus.cc:482] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:45:06.298453 8689 raft_consensus.cc:3037] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:06.300707 8689 raft_consensus.cc:504] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570314a6c2ff49d483fbdf024369e3e1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45327 } } peers { permanent_uuid: "8cb250fb17fc444c947ce21dd6d9ac43" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 32837 } } peers { permanent_uuid: "1a4b6984ca094ae5b3a2fbb2b9760298" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 40163 } }
I20260806 04:45:06.301291 8689 leader_election.cc:288] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 8cb250fb17fc444c947ce21dd6d9ac43 (127.7.113.193:32837), 1a4b6984ca094ae5b3a2fbb2b9760298 (127.7.113.195:40163)
I20260806 04:45:06.301707 8348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2febef3b892c4d11ae1a8d0878ec5a15" candidate_uuid: "570314a6c2ff49d483fbdf024369e3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cb250fb17fc444c947ce21dd6d9ac43"
I20260806 04:45:06.301791 8619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2febef3b892c4d11ae1a8d0878ec5a15" candidate_uuid: "570314a6c2ff49d483fbdf024369e3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4b6984ca094ae5b3a2fbb2b9760298"
I20260806 04:45:06.301904 8348 raft_consensus.cc:3037] T 2febef3b892c4d11ae1a8d0878ec5a15 P 8cb250fb17fc444c947ce21dd6d9ac43 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:06.302007 8619 raft_consensus.cc:3037] T 2febef3b892c4d11ae1a8d0878ec5a15 P 1a4b6984ca094ae5b3a2fbb2b9760298 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:06.304111 8348 raft_consensus.cc:2454] T 2febef3b892c4d11ae1a8d0878ec5a15 P 8cb250fb17fc444c947ce21dd6d9ac43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570314a6c2ff49d483fbdf024369e3e1 in term 1.
I20260806 04:45:06.304211 8619 raft_consensus.cc:2454] T 2febef3b892c4d11ae1a8d0878ec5a15 P 1a4b6984ca094ae5b3a2fbb2b9760298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570314a6c2ff49d483fbdf024369e3e1 in term 1.
I20260806 04:45:06.304525 8418 leader_election.cc:302] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570314a6c2ff49d483fbdf024369e3e1, 8cb250fb17fc444c947ce21dd6d9ac43; no voters:
I20260806 04:45:06.304785 8689 raft_consensus.cc:2781] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:06.305210 8689 raft_consensus.cc:686] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 570314a6c2ff49d483fbdf024369e3e1, State: Running, Role: LEADER
I20260806 04:45:06.305795 8689 consensus_queue.cc:237] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570314a6c2ff49d483fbdf024369e3e1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45327 } } peers { permanent_uuid: "8cb250fb17fc444c947ce21dd6d9ac43" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 32837 } } peers { permanent_uuid: "1a4b6984ca094ae5b3a2fbb2b9760298" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 40163 } }
I20260806 04:45:06.310920 8202 catalog_manager.cc:5495] T 2febef3b892c4d11ae1a8d0878ec5a15 P 570314a6c2ff49d483fbdf024369e3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 570314a6c2ff49d483fbdf024369e3e1 (127.7.113.194). New cstate: current_term: 1 leader_uuid: "570314a6c2ff49d483fbdf024369e3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570314a6c2ff49d483fbdf024369e3e1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cb250fb17fc444c947ce21dd6d9ac43" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 32837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a4b6984ca094ae5b3a2fbb2b9760298" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 40163 } health_report { overall_health: UNKNOWN } } }
Aug 06 04:45:06 dist-test-slave-0b58 krb5kdc[8157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:45:06.360435 8680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.345467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34428 (local address 127.7.113.193:32837)
0806 04:45:06.345651 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:06.345656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:06.346310 (+ 654us) server_negotiation.cc:407] Connection header received
0806 04:45:06.346519 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:06.346523 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:06.346588 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:06.346704 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:06.348221 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.349021 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.350288 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.350723 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.350859 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.354852 (+ 3993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:06.354866 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:06.354882 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:06.354915 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:06.357730 (+ 2815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:06.358375 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:06.358381 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:06.358384 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:06.358533 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:06.358915 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:06.358920 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:06.358923 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:06.359285 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:06.359602 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:06.359837 (+ 235us) server_negotiation.cc:299] Negotiation successful
0806 04:45:06.360043 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Aug 06 04:45:06 dist-test-slave-0b58 krb5kdc[8157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991506, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 04:45:06 dist-test-slave-0b58 krb5kdc[8157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991506, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:45:06.411247 8680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.395152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34442 (local address 127.7.113.193:32837)
0806 04:45:06.395395 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:06.395403 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:06.395813 (+ 410us) server_negotiation.cc:407] Connection header received
0806 04:45:06.396030 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:06.396034 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:06.396108 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:06.396236 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:06.397603 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.398361 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.399719 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.400345 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.400464 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.404634 (+ 4170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:06.404641 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:06.404646 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:06.404689 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:06.408491 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:06.409241 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:06.409247 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:06.409251 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:06.409404 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:06.409797 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:06.409802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:06.409805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:06.410186 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:06.410437 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:06.410660 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 04:45:06.410885 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 04:45:06 dist-test-slave-0b58 krb5kdc[8157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 04:45:06 dist-test-slave-0b58 krb5kdc[8157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:45:06.462875 8680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.449650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34448 (local address 127.7.113.193:32837)
0806 04:45:06.449902 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:06.449908 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:06.450122 (+ 214us) server_negotiation.cc:407] Connection header received
0806 04:45:06.450279 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:06.450282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:06.450349 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:06.450433 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:06.451807 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.452560 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.453754 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.454170 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.454263 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.458075 (+ 3812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:06.458081 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:06.458085 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:06.458118 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:06.460567 (+ 2449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:06.461117 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:06.461121 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:06.461123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:06.461229 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:06.461543 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:06.461546 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:06.461548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:06.461835 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:06.462011 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:06.462235 (+ 224us) server_negotiation.cc:299] Negotiation successful
0806 04:45:06.462414 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
W20260806 04:45:06.465256 8308 tablet_service.cc:2908] Rejecting scan request for tablet 2febef3b892c4d11ae1a8d0878ec5a15: Uninitialized: clean time has not yet been initialized
I20260806 04:45:06.468770 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 8264
I20260806 04:45:06.482491 8680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.469890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34458 (local address 127.7.113.193:32837)
0806 04:45:06.470073 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:06.470079 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:06.470426 (+ 347us) server_negotiation.cc:407] Connection header received
0806 04:45:06.470610 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:06.470616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:06.470697 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:06.470799 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:06.471931 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.472691 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.473922 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.474352 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.474498 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.477028 (+ 2530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:06.477033 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:06.477037 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:06.477066 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:06.479550 (+ 2484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:06.480558 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:06.480563 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:06.480573 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:06.480691 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:06.481055 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:06.481061 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:06.481064 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:06.481353 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:06.481657 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:06.481937 (+ 280us) server_negotiation.cc:299] Negotiation successful
0806 04:45:06.482166 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 04:45:06.483377 8388 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:06.574448 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 8264
I20260806 04:45:06.594165 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 8399
Aug 06 04:45:06 dist-test-slave-0b58 krb5kdc[8157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:45:06.608614 8708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.594941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44604 (local address 127.7.113.194:45327)
0806 04:45:06.595399 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:06.595403 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:06.595426 (+ 23us) server_negotiation.cc:407] Connection header received
0806 04:45:06.595480 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:06.595483 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:06.595544 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:06.595635 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:06.596878 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.597558 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.598777 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.599170 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.599269 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.603203 (+ 3934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:06.603216 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:06.603232 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:06.603279 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:06.605936 (+ 2657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:06.606671 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:06.606678 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:06.606680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:06.606812 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:06.607141 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:06.607145 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:06.607148 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:06.607555 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:06.607842 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:06.607990 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 04:45:06.608161 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":263,"threads_started":1}
I20260806 04:45:06.609344 8523 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:06.698616 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 8399
I20260806 04:45:06.717144 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 8534
Aug 06 04:45:06 dist-test-slave-0b58 krb5kdc[8157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:45:06.731462 8682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:06.717889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48012 (local address 127.7.113.195:40163)
0806 04:45:06.718062 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:06.718066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:06.718133 (+ 67us) server_negotiation.cc:407] Connection header received
0806 04:45:06.718280 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:06.718284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:06.718346 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:06.718431 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:06.719618 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.720389 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.721677 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:06.722071 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:06.722161 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:06.726273 (+ 4112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:06.726286 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:06.726302 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:06.726332 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:06.729063 (+ 2731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:06.729660 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:06.729667 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:06.729669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:06.729853 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:06.730224 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:06.730228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:06.730230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:06.730575 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:06.730797 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:06.731035 (+ 238us) server_negotiation.cc:299] Negotiation successful
0806 04:45:06.731193 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 04:45:06.732074 8659 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:06.818850 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 8534
I20260806 04:45:06.836921 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 8171
I20260806 04:45:06.838120 8233 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:06.943456 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 8171
2026-08-06T04:45:06Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4244 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:45:07 dist-test-slave-0b58 krb5kdc[8714](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:45:07 dist-test-slave-0b58 krb5kdc[8714](info): set up 2 sockets
Aug 06 04:45:07 dist-test-slave-0b58 krb5kdc[8714](info): commencing operation
krb5kdc: starting...
W20260806 04:45:08.046205 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.001s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:45:08 dist-test-slave-0b58 krb5kdc[8714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:45:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:45:08.243427 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:45091
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:45091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:08.560032 8727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:08.560389 8727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:08.560550 8727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:08.567651 8727 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:08.567749 8727 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 04:45:08.567842 8727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:08.567955 8727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:08.568040 8727 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:08.568132 8727 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:45:08.577739 8727 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:45091
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:45091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:08.579035 8727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:08.580408 8727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:08.591892 8732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:08.591856 8735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:08.591919 8733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:08.593050 8727 server_base.cc:1034] running on GCE node
I20260806 04:45:08.593832 8727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:08.595116 8727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:08.596376 8727 hybrid_clock.cc:648] HybridClock initialized: now 1785991508596321 us; error 41 us; skew 500 ppm
I20260806 04:45:08.596690 8727 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:08 dist-test-slave-0b58 krb5kdc[8714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991508, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:08.599583 8727 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:45:08.600988 8727 webserver.cc:460] Webserver started at http://127.7.113.254:39053/ using document root <none> and password file <none>
I20260806 04:45:08.601662 8727 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:08.601801 8727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:08.602110 8727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:08.605057 8727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "1de3c62c44ab42858ca5b517555ff0a3"
format_stamp: "Formatted at 2026-08-06 04:45:08 on dist-test-slave-0b58"
server_key: "fc2133d4eef854d1f0702487d4617aa7"
server_key_iv: "2f39f9d0dac76ee5706821cb1b45faca"
server_key_version: "encryptionkey@0"
I20260806 04:45:08.605927 8727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "1de3c62c44ab42858ca5b517555ff0a3"
format_stamp: "Formatted at 2026-08-06 04:45:08 on dist-test-slave-0b58"
server_key: "fc2133d4eef854d1f0702487d4617aa7"
server_key_iv: "2f39f9d0dac76ee5706821cb1b45faca"
server_key_version: "encryptionkey@0"
I20260806 04:45:08.610919 8727 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 04:45:08.614225 8742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:08.615440 8727 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260806 04:45:08.615618 8727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "1de3c62c44ab42858ca5b517555ff0a3"
format_stamp: "Formatted at 2026-08-06 04:45:08 on dist-test-slave-0b58"
server_key: "fc2133d4eef854d1f0702487d4617aa7"
server_key_iv: "2f39f9d0dac76ee5706821cb1b45faca"
server_key_version: "encryptionkey@0"
I20260806 04:45:08.615837 8727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:08.667438 8727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:08.671589 8727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:08.671859 8727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:08.693755 8727 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:45091
I20260806 04:45:08.693809 8803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:45091 every 8 connection(s)
I20260806 04:45:08.695030 8727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:08.698587 8804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:08.702549 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 8727
I20260806 04:45:08.702782 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:08.703639 7623 external_mini_cluster.cc:1428] Setting key d60b19fec4d27efbda5a0eadfe4b508d
I20260806 04:45:08.710032 8804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3: Bootstrap starting.
I20260806 04:45:08.712996 8804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:08.713950 8804 log.cc:824] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:08.716743 8804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3: No bootstrap required, opened a new log
Aug 06 04:45:08 dist-test-slave-0b58 krb5kdc[8714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:08.724932 8804 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1de3c62c44ab42858ca5b517555ff0a3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45091 } }
I20260806 04:45:08.725328 8804 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:08.725462 8804 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de3c62c44ab42858ca5b517555ff0a3, State: Initialized, Role: FOLLOWER
I20260806 04:45:08.726022 8804 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1de3c62c44ab42858ca5b517555ff0a3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45091 } }
I20260806 04:45:08.726254 8807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:08.705762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35096 (local address 127.7.113.254:45091)
0806 04:45:08.706527 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:08.706538 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:08.706578 (+ 40us) server_negotiation.cc:407] Connection header received
0806 04:45:08.708897 (+ 2319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:08.708919 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:08.709271 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:08.709628 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:08.711059 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:08.712427 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:08.713692 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:08.714542 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:08.714761 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:08.718875 (+ 4114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:08.718882 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:08.718895 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:08.718939 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:08.722012 (+ 3073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:08.722732 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:08.722751 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:08.722758 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:08.722921 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:08.723310 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:08.723315 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:08.723320 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:08.723829 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:08.724155 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:08.724604 (+ 449us) server_negotiation.cc:299] Negotiation successful
0806 04:45:08.725016 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":361,"threads_started":1}
I20260806 04:45:08.726296 8804 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:08.726426 8804 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:08.726611 8804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:08.729022 8804 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1de3c62c44ab42858ca5b517555ff0a3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45091 } }
I20260806 04:45:08.729513 8804 leader_election.cc:302] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1de3c62c44ab42858ca5b517555ff0a3; no voters:
I20260806 04:45:08.730044 8804 leader_election.cc:288] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:08.730189 8809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:08.730872 8809 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1de3c62c44ab42858ca5b517555ff0a3, State: Running, Role: LEADER
I20260806 04:45:08.731380 8809 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1de3c62c44ab42858ca5b517555ff0a3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45091 } }
I20260806 04:45:08.731986 8804 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:08.734876 8810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1de3c62c44ab42858ca5b517555ff0a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1de3c62c44ab42858ca5b517555ff0a3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45091 } } }
I20260806 04:45:08.735380 8810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:08.737031 8811 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1de3c62c44ab42858ca5b517555ff0a3. Latest consensus state: current_term: 1 leader_uuid: "1de3c62c44ab42858ca5b517555ff0a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1de3c62c44ab42858ca5b517555ff0a3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45091 } } }
I20260806 04:45:08.737445 8811 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:08.740397 8820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:08.745301 8820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:08.753847 8820 catalog_manager.cc:1347] Generated new cluster ID: 1e132366ec4e40fea4dcd848c89352e4
I20260806 04:45:08.753965 8820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:08.765473 8820 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:08.767294 8820 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:08.780855 8820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3: Generated new TSK 0
I20260806 04:45:08.781844 8820 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:45:08.836483 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45091
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:09.158627 8831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:09.158900 8831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:09.159096 8831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:09.166272 8831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:09.166388 8831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:09.166563 8831 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 04:45:09.166677 8831 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:45:09.176019 8831 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.113.254:45091
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:09.177284 8831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:09.178603 8831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:09.191841 8836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:09.191709 8839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:09.191804 8837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:09.192663 8831 server_base.cc:1034] running on GCE node
I20260806 04:45:09.193187 8831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:09.193971 8831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:09.195176 8831 hybrid_clock.cc:648] HybridClock initialized: now 1785991509195118 us; error 31 us; skew 500 ppm
I20260806 04:45:09.195410 8831 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:09 dist-test-slave-0b58 krb5kdc[8714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991509, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:09.198362 8831 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:45:09.199744 8831 webserver.cc:460] Webserver started at http://127.7.113.193:37569/ using document root <none> and password file <none>
I20260806 04:45:09.200479 8831 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:09.200603 8831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:09.200924 8831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:09.203696 8831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "fb77314ac3354c069ecdb1cc35437ea7"
format_stamp: "Formatted at 2026-08-06 04:45:09 on dist-test-slave-0b58"
server_key: "1b8e9e2e67df23276a47ecca9624880e"
server_key_iv: "1ab121c950844981a018965e4a1b2afe"
server_key_version: "encryptionkey@0"
I20260806 04:45:09.204591 8831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "fb77314ac3354c069ecdb1cc35437ea7"
format_stamp: "Formatted at 2026-08-06 04:45:09 on dist-test-slave-0b58"
server_key: "1b8e9e2e67df23276a47ecca9624880e"
server_key_iv: "1ab121c950844981a018965e4a1b2afe"
server_key_version: "encryptionkey@0"
I20260806 04:45:09.209527 8831 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260806 04:45:09.213088 8846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:09.214442 8831 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:45:09.214613 8831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "fb77314ac3354c069ecdb1cc35437ea7"
format_stamp: "Formatted at 2026-08-06 04:45:09 on dist-test-slave-0b58"
server_key: "1b8e9e2e67df23276a47ecca9624880e"
server_key_iv: "1ab121c950844981a018965e4a1b2afe"
server_key_version: "encryptionkey@0"
I20260806 04:45:09.214847 8831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:09.229452 8831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:09.233383 8831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:09.233680 8831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:09.236938 8831 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:09.237044 8831 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:09.237193 8831 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:09.237311 8831 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 06 04:45:09 dist-test-slave-0b58 krb5kdc[8714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991509, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:09.259789 8856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:09.237431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:50213 (local address 127.7.113.254:45091)
0806 04:45:09.238213 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:09.238222 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:09.239259 (+ 1037us) server_negotiation.cc:407] Connection header received
0806 04:45:09.242262 (+ 3003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:09.242270 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:09.242368 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:09.242487 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:09.244823 (+ 2336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.246257 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.247852 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.248704 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.248848 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:09.253510 (+ 4662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:09.253515 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:09.253518 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:09.253551 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:09.256817 (+ 3266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:09.257529 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:09.257534 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:09.257538 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:09.257669 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:09.258105 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:09.258110 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:09.258113 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:09.258382 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:09.258562 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:09.259202 (+ 640us) server_negotiation.cc:299] Negotiation successful
0806 04:45:09.259428 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":550,"threads_started":1}
I20260806 04:45:09.261054 8857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:09.238072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45091 (local address 127.7.113.193:50213)
0806 04:45:09.239068 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:09.239114 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:09.241909 (+ 2795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:09.242913 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:09.242927 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:09.243743 (+ 816us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:09.244615 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:09.244633 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.246440 (+ 1807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.246443 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:09.247713 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:09.247724 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.248936 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.248942 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:09.249119 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:09.249841 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:09.249876 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:09.253260 (+ 3384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:09.256962 (+ 3702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:09.256970 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:09.256984 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:09.257400 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:09.257784 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:09.257789 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:09.257793 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:09.257983 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:09.258515 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:09.258523 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:09.258856 (+ 333us) client_negotiation.cc:769] Sending connection context
0806 04:45:09.259106 (+ 250us) client_negotiation.cc:240] Negotiation successful
0806 04:45:09.259592 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"thread_start_us":409,"threads_started":1}
I20260806 04:45:09.288321 8856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:09.271318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:39941 (local address 127.7.113.254:45091)
0806 04:45:09.271536 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:09.271542 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:09.272643 (+ 1101us) server_negotiation.cc:407] Connection header received
0806 04:45:09.272805 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:09.272813 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:09.272913 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:09.273031 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:09.273937 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.275202 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.277056 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.277909 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.278054 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:09.280845 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:09.280854 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:09.280861 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:09.280910 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:09.284527 (+ 3617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:09.285600 (+ 1073us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:09.285608 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:09.285612 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:09.285791 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:09.286324 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:09.286331 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:09.286336 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:09.286727 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:09.286887 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:09.287593 (+ 706us) server_negotiation.cc:299] Negotiation successful
0806 04:45:09.287870 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 04:45:09.288642 8915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:09.271553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45091 (local address 127.7.113.193:39941)
0806 04:45:09.272498 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:09.272523 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:09.272681 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:09.273073 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:09.273078 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:09.273498 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:09.273789 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:09.273797 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.275342 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.275350 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:09.276902 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:09.276915 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.278170 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.278180 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:09.278434 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:09.279257 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:09.279301 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:09.280630 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:09.284706 (+ 4076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:09.284713 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:09.284719 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:09.285424 (+ 705us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:09.285942 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:09.285949 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:09.285954 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:09.286152 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:09.286889 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:09.286898 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:09.287253 (+ 355us) client_negotiation.cc:769] Sending connection context
0806 04:45:09.287446 (+ 193us) client_negotiation.cc:240] Negotiation successful
0806 04:45:09.287966 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"thread_start_us":545,"threads_started":1}
I20260806 04:45:09.291850 8831 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:34835
I20260806 04:45:09.291913 8968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:34835 every 8 connection(s)
I20260806 04:45:09.293288 8831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:45:09.295255 8969 heartbeater.cc:347] Connected to a master server at 127.7.113.254:45091
I20260806 04:45:09.295487 8969 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:09.296083 8969 heartbeater.cc:511] Master 127.7.113.254:45091 requested a full tablet report, sending...
I20260806 04:45:09.296803 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 8831
I20260806 04:45:09.297053 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:45:09.297816 7623 external_mini_cluster.cc:1428] Setting key 31a4b4044df5090d406dc6e0bc0ea224
I20260806 04:45:09.298416 8759 ts_manager.cc:194] Registered new tserver with Master: fb77314ac3354c069ecdb1cc35437ea7 (127.7.113.193:34835)
I20260806 04:45:09.300103 8759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:50213
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:45:09.338852 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45091
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:09.652029 8973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:09.652366 8973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:09.652537 8973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:09.659561 8973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:09.659705 8973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:09.659857 8973 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 04:45:09.660001 8973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:45:09.669632 8973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.113.254:45091
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:09.670867 8973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:09.672179 8973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:09.684947 8979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:09.685025 8978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:09.684991 8981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:09.686046 8973 server_base.cc:1034] running on GCE node
I20260806 04:45:09.686619 8973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:09.687453 8973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:09.688685 8973 hybrid_clock.cc:648] HybridClock initialized: now 1785991509688632 us; error 51 us; skew 500 ppm
I20260806 04:45:09.688971 8973 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:09 dist-test-slave-0b58 krb5kdc[8714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991509, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:09.691888 8973 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:45:09.693475 8973 webserver.cc:460] Webserver started at http://127.7.113.194:39583/ using document root <none> and password file <none>
I20260806 04:45:09.694303 8973 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:09.694406 8973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:09.694749 8973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:09.698412 8973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "60283b0c9d2f431fbb014cfdac9c6d48"
format_stamp: "Formatted at 2026-08-06 04:45:09 on dist-test-slave-0b58"
server_key: "69c58d8e3c37c86d70564fa13efb15b2"
server_key_iv: "21219c599029636986a3b47e223de400"
server_key_version: "encryptionkey@0"
I20260806 04:45:09.699379 8973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "60283b0c9d2f431fbb014cfdac9c6d48"
format_stamp: "Formatted at 2026-08-06 04:45:09 on dist-test-slave-0b58"
server_key: "69c58d8e3c37c86d70564fa13efb15b2"
server_key_iv: "21219c599029636986a3b47e223de400"
server_key_version: "encryptionkey@0"
I20260806 04:45:09.705550 8973 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 04:45:09.709694 8988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:09.711145 8973 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260806 04:45:09.711299 8973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "60283b0c9d2f431fbb014cfdac9c6d48"
format_stamp: "Formatted at 2026-08-06 04:45:09 on dist-test-slave-0b58"
server_key: "69c58d8e3c37c86d70564fa13efb15b2"
server_key_iv: "21219c599029636986a3b47e223de400"
server_key_version: "encryptionkey@0"
I20260806 04:45:09.711512 8973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:09.727473 8973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:09.731216 8973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:09.731441 8973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:09.734390 8973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:09.734489 8973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:09.734582 8973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:09.734665 8973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 04:45:09 dist-test-slave-0b58 krb5kdc[8714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991509, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:09.758306 8856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:09.734572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:58599 (local address 127.7.113.254:45091)
0806 04:45:09.734798 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:09.734806 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:09.736336 (+ 1530us) server_negotiation.cc:407] Connection header received
0806 04:45:09.738381 (+ 2045us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:09.738388 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:09.738477 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:09.738598 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:09.740669 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.741962 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.745375 (+ 3413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.745838 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.745977 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:09.751222 (+ 5245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:09.751227 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:09.751230 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:09.751265 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:09.754525 (+ 3260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:09.755720 (+ 1195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:09.755726 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:09.755730 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:09.755892 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:09.756554 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:09.756559 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:09.756564 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:09.756853 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:09.757021 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:09.757727 (+ 706us) server_negotiation.cc:299] Negotiation successful
0806 04:45:09.757965 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 04:45:09.759351 8997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:09.735091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45091 (local address 127.7.113.194:58599)
0806 04:45:09.736146 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:09.736203 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:09.738072 (+ 1869us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:09.738820 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:09.738828 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:09.739549 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:09.740407 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:09.740429 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.742187 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.742200 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:09.745221 (+ 3021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:09.745246 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.746093 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.746102 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:09.746478 (+ 376us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:09.747410 (+ 932us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:09.747449 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:09.750977 (+ 3528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:09.754678 (+ 3701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:09.754687 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:09.754707 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:09.755541 (+ 834us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:09.756068 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:09.756075 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:09.756081 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:09.756418 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:09.756998 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:09.757006 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:09.757366 (+ 360us) client_negotiation.cc:769] Sending connection context
0806 04:45:09.757624 (+ 258us) client_negotiation.cc:240] Negotiation successful
0806 04:45:09.758139 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":762,"thread_start_us":503,"threads_started":1}
I20260806 04:45:09.782472 8856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:09.766261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:57185 (local address 127.7.113.254:45091)
0806 04:45:09.766482 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:09.766491 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:09.767377 (+ 886us) server_negotiation.cc:407] Connection header received
0806 04:45:09.767490 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:09.767498 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:09.767587 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:09.767697 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:09.769196 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.770469 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.772358 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.773131 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.773271 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:09.776338 (+ 3067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:09.776343 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:09.776346 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:09.776377 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:09.779562 (+ 3185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:09.780234 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:09.780240 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:09.780251 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:09.780416 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:09.780771 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:09.780778 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:09.780783 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:09.781323 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:09.781484 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:09.781893 (+ 409us) server_negotiation.cc:299] Negotiation successful
0806 04:45:09.782120 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 04:45:09.782600 9056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:09.766290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45091 (local address 127.7.113.194:57185)
0806 04:45:09.767273 (+ 983us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:09.767289 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:09.767395 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:09.767766 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:09.767773 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:09.768528 (+ 755us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:09.769000 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:09.769035 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.770628 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.770636 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:09.772121 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:09.772135 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:09.773618 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:09.773631 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:09.773890 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:09.774756 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:09.774795 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:09.776078 (+ 1283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:09.779690 (+ 3612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:09.779699 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:09.779703 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:09.780115 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:09.780526 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:09.780531 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:09.780535 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:09.780663 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:09.781462 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:09.781467 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:09.781652 (+ 185us) client_negotiation.cc:769] Sending connection context
0806 04:45:09.781801 (+ 149us) client_negotiation.cc:240] Negotiation successful
0806 04:45:09.782141 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":850,"thread_start_us":624,"threads_started":1}
I20260806 04:45:09.791352 8973 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:34697
I20260806 04:45:09.791391 9108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:34697 every 8 connection(s)
I20260806 04:45:09.792577 8973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:45:09.794480 9109 heartbeater.cc:347] Connected to a master server at 127.7.113.254:45091
I20260806 04:45:09.794664 9109 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:09.795233 9109 heartbeater.cc:511] Master 127.7.113.254:45091 requested a full tablet report, sending...
I20260806 04:45:09.796243 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 8973
I20260806 04:45:09.796487 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:45:09.796638 8759 ts_manager.cc:194] Registered new tserver with Master: 60283b0c9d2f431fbb014cfdac9c6d48 (127.7.113.194:34697)
I20260806 04:45:09.797055 7623 external_mini_cluster.cc:1428] Setting key 43efa7a4161de2475a7c658b14d13f98
I20260806 04:45:09.797704 8759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:58599
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:45:09.839993 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45091
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:10.154946 9113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:10.155246 9113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:10.155427 9113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:10.163367 9113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:10.163509 9113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:10.163671 9113 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 04:45:10.163806 9113 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:45:10.173573 9113 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.113.254:45091
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:10.174860 9113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:10.176182 9113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:10.188827 9118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:10.188819 9119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:10.189641 9121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:10.189881 9113 server_base.cc:1034] running on GCE node
I20260806 04:45:10.190465 9113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:10.191298 9113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:10.192528 9113 hybrid_clock.cc:648] HybridClock initialized: now 1785991510192483 us; error 43 us; skew 500 ppm
I20260806 04:45:10.192811 9113 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:10 dist-test-slave-0b58 krb5kdc[8714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991510, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:10.195878 9113 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:45:10.197238 9113 webserver.cc:460] Webserver started at http://127.7.113.195:45499/ using document root <none> and password file <none>
I20260806 04:45:10.197844 9113 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:10.197925 9113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:10.198169 9113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:10.200909 9113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "7d9631fb620c4de98a878cb4ac5381b8"
format_stamp: "Formatted at 2026-08-06 04:45:10 on dist-test-slave-0b58"
server_key: "a6f32f167ca97fe5984dac9cf7383734"
server_key_iv: "7b14cb76b1c78283728150a2a9c9493c"
server_key_version: "encryptionkey@0"
I20260806 04:45:10.201648 9113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "7d9631fb620c4de98a878cb4ac5381b8"
format_stamp: "Formatted at 2026-08-06 04:45:10 on dist-test-slave-0b58"
server_key: "a6f32f167ca97fe5984dac9cf7383734"
server_key_iv: "7b14cb76b1c78283728150a2a9c9493c"
server_key_version: "encryptionkey@0"
I20260806 04:45:10.206497 9113 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260806 04:45:10.209754 9128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:10.210976 9113 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 04:45:10.211099 9113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "7d9631fb620c4de98a878cb4ac5381b8"
format_stamp: "Formatted at 2026-08-06 04:45:10 on dist-test-slave-0b58"
server_key: "a6f32f167ca97fe5984dac9cf7383734"
server_key_iv: "7b14cb76b1c78283728150a2a9c9493c"
server_key_version: "encryptionkey@0"
I20260806 04:45:10.211266 9113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:10.247812 9113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:10.252058 9113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:10.252341 9113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:10.254930 9113 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:10.255038 9113 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:10.255225 9113 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:10.255298 9113 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 04:45:10 dist-test-slave-0b58 krb5kdc[8714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991510, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:10.279832 8856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.255763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:57483 (local address 127.7.113.254:45091)
0806 04:45:10.255963 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:10.255969 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:10.257413 (+ 1444us) server_negotiation.cc:407] Connection header received
0806 04:45:10.259359 (+ 1946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:10.259369 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:10.259478 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:10.259584 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:10.261665 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.262729 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.266113 (+ 3384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.266509 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.266668 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.271698 (+ 5030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:10.271706 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:10.271712 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:10.271765 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:10.275944 (+ 4179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:10.277048 (+ 1104us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:10.277060 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:10.277063 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:10.277256 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:10.277862 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:10.277870 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:10.277875 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:10.278199 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:10.278358 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:10.279225 (+ 867us) server_negotiation.cc:299] Negotiation successful
0806 04:45:10.279455 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 04:45:10.281240 9137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.256309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45091 (local address 127.7.113.195:57483)
0806 04:45:10.257216 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:10.257266 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:10.259091 (+ 1825us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:10.259834 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:10.259843 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:10.260387 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:10.261437 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:10.261481 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.262939 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.262951 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:10.265978 (+ 3027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:10.265992 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.266982 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.266988 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:10.267256 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.268134 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:10.268171 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:10.271435 (+ 3264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:10.276141 (+ 4706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:10.276150 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:10.276162 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:10.276918 (+ 756us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:10.277412 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:10.277420 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:10.277425 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:10.277659 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:10.278342 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:10.278349 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:10.278775 (+ 426us) client_negotiation.cc:769] Sending connection context
0806 04:45:10.279116 (+ 341us) client_negotiation.cc:240] Negotiation successful
0806 04:45:10.279646 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":362,"threads_started":1}
I20260806 04:45:10.300076 8856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.287634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:45359 (local address 127.7.113.254:45091)
0806 04:45:10.288168 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:10.288174 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:10.288553 (+ 379us) server_negotiation.cc:407] Connection header received
0806 04:45:10.288748 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:10.288751 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:10.288812 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:10.288889 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:10.290319 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.291035 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.292455 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.292893 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.292960 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.294969 (+ 2009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:10.294975 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:10.294980 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:10.295016 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:10.297545 (+ 2529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:10.298207 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:10.298214 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:10.298217 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:10.298342 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:10.298687 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:10.298693 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:10.298696 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:10.298970 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:10.299118 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:10.299525 (+ 407us) server_negotiation.cc:299] Negotiation successful
0806 04:45:10.299728 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406}
I20260806 04:45:10.300161 9220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.287679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45091 (local address 127.7.113.195:45359)
0806 04:45:10.288425 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:10.288449 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:10.288608 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:10.288954 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:10.288961 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:10.289681 (+ 720us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:10.290154 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:10.290170 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.291167 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.291174 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:10.292225 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:10.292236 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.293175 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.293179 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:10.293337 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.293934 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:10.293950 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:10.294797 (+ 847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:10.297676 (+ 2879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:10.297710 (+ 34us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:10.297714 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:10.298094 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:10.298450 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:10.298455 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:10.298459 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:10.298580 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:10.299083 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:10.299088 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:10.299258 (+ 170us) client_negotiation.cc:769] Sending connection context
0806 04:45:10.299425 (+ 167us) client_negotiation.cc:240] Negotiation successful
0806 04:45:10.299709 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":363,"threads_started":1}
I20260806 04:45:10.302634 8969 heartbeater.cc:503] Master 127.7.113.254:45091 was elected leader, sending a full tablet report...
I20260806 04:45:10.314532 9113 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:34917
I20260806 04:45:10.314585 9247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:34917 every 8 connection(s)
I20260806 04:45:10.315840 9113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:45:10.317827 9248 heartbeater.cc:347] Connected to a master server at 127.7.113.254:45091
I20260806 04:45:10.318111 9248 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:10.318805 9248 heartbeater.cc:511] Master 127.7.113.254:45091 requested a full tablet report, sending...
I20260806 04:45:10.320132 8759 ts_manager.cc:194] Registered new tserver with Master: 7d9631fb620c4de98a878cb4ac5381b8 (127.7.113.195:34917)
I20260806 04:45:10.321004 8759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:57483
I20260806 04:45:10.322067 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 9113
I20260806 04:45:10.322264 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:45:10.322799 7623 external_mini_cluster.cc:1428] Setting key 8cd9053c568355cfb26786b6dd121d1e
I20260806 04:45:10.325629 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 04:45:10 dist-test-slave-0b58 krb5kdc[8714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991510, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 04:45:10 dist-test-slave-0b58 krb5kdc[8714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991510, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:10.377530 8856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.362426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35098 (local address 127.7.113.254:45091)
0806 04:45:10.362649 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:10.362657 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:10.363101 (+ 444us) server_negotiation.cc:407] Connection header received
0806 04:45:10.363336 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:10.363341 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:10.363460 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:10.363569 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:10.365195 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.366008 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.367330 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.367750 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.367898 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.372080 (+ 4182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:10.372086 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:10.372089 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:10.372121 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:10.374501 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:10.375145 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:10.375151 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:10.375155 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:10.375292 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:10.375703 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:10.375709 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:10.375715 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:10.376295 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:10.376556 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:10.376879 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 04:45:10.377119 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 04:45:10.381654 8759 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35098:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:45:10.388628 8759 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:45:10.411391 9264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.400101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:34697 (local address 127.0.0.1:43342)
0806 04:45:10.401384 (+ 1283us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:10.401429 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:10.401641 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:10.403180 (+ 1539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:10.403187 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:10.403252 (+ 65us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:10.403777 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:10.403796 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.405872 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.405877 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:10.408468 (+ 2591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:10.408483 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.410285 (+ 1802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.410294 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:10.410551 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.410603 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 04:45:10.410714 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 04:45:10.410927 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":944,"mutex_wait_us":48,"thread_start_us":1886,"threads_started":1}
I20260806 04:45:10.411433 9262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.400232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:34835 (local address 127.0.0.1:41274)
0806 04:45:10.402538 (+ 2306us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:10.402555 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:10.402665 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:10.403898 (+ 1233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:10.403903 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:10.403930 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:10.404426 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:10.404439 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.406351 (+ 1912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.406355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:10.408571 (+ 2216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:10.408582 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.410318 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.410323 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:10.410843 (+ 520us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.410875 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 04:45:10.410943 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 04:45:10.411056 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2198,"mutex_wait_us":306,"thread_start_us":1148,"threads_started":1}
I20260806 04:45:10.412220 9265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.401049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41274 (local address 127.7.113.193:34835)
0806 04:45:10.403143 (+ 2094us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:10.403151 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:10.403176 (+ 25us) server_negotiation.cc:407] Connection header received
0806 04:45:10.403302 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:10.403311 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:10.403515 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:10.404604 (+ 1089us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:10.404791 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.406176 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.408762 (+ 2586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.410101 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.410573 (+ 472us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.410776 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:10.411786 (+ 1010us) server_negotiation.cc:299] Negotiation successful
0806 04:45:10.411963 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1932,"thread_start_us":1806,"threads_started":1}
I20260806 04:45:10.413038 9263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.400328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43342 (local address 127.7.113.194:34697)
0806 04:45:10.402530 (+ 2202us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:10.402538 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:10.402569 (+ 31us) server_negotiation.cc:407] Connection header received
0806 04:45:10.402665 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:10.402673 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:10.402941 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:10.404037 (+ 1096us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:10.404281 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.405708 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.408686 (+ 2978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.410015 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.412171 (+ 2156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.412492 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:10.412563 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 04:45:10.412768 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2043,"thread_start_us":3578,"threads_started":1}
I20260806 04:45:10.416203 8898 tablet_service.cc:1467] Processing CreateTablet for tablet 52308721dac644feb58a59b6d90c2658 (DEFAULT_TABLE table=test-table [id=52a09faceb314fd08531dc7446a4e876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:10.416651 9038 tablet_service.cc:1467] Processing CreateTablet for tablet 52308721dac644feb58a59b6d90c2658 (DEFAULT_TABLE table=test-table [id=52a09faceb314fd08531dc7446a4e876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:10.417666 8898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52308721dac644feb58a59b6d90c2658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:10.417915 9038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52308721dac644feb58a59b6d90c2658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:10.421065 9264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.402465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:34917 (local address 127.0.0.1:40294)
0806 04:45:10.411624 (+ 9159us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:10.411643 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:10.411741 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:10.414183 (+ 2442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:10.414187 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:10.414214 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:10.414383 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:10.414394 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.416713 (+ 2319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.416723 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:10.418500 (+ 1777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:10.418515 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.420340 (+ 1825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.420346 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:10.420543 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.420576 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 04:45:10.420646 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 04:45:10.420776 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9068,"thread_start_us":10853,"threads_started":1}
I20260806 04:45:10.422151 9267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.403515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40294 (local address 127.7.113.195:34917)
0806 04:45:10.413003 (+ 9488us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:10.413011 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:10.413046 (+ 35us) server_negotiation.cc:407] Connection header received
0806 04:45:10.413578 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:10.413587 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:10.413800 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:10.414564 (+ 764us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:10.414890 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.416523 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.418750 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.420114 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.421377 (+ 1263us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.421598 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:10.421670 (+ 72us) server_negotiation.cc:299] Negotiation successful
0806 04:45:10.421821 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9310,"thread_start_us":11339,"threads_started":1}
I20260806 04:45:10.425668 9178 tablet_service.cc:1467] Processing CreateTablet for tablet 52308721dac644feb58a59b6d90c2658 (DEFAULT_TABLE table=test-table [id=52a09faceb314fd08531dc7446a4e876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:10.427076 9178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52308721dac644feb58a59b6d90c2658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:10.432317 9268 tablet_bootstrap.cc:492] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7: Bootstrap starting.
I20260806 04:45:10.434353 9269 tablet_bootstrap.cc:492] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48: Bootstrap starting.
I20260806 04:45:10.436987 9268 tablet_bootstrap.cc:654] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:10.437705 9269 tablet_bootstrap.cc:654] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:10.438110 9268 log.cc:824] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:10.438967 9269 log.cc:824] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:10.440927 9268 tablet_bootstrap.cc:492] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7: No bootstrap required, opened a new log
I20260806 04:45:10.441309 9268 ts_tablet_manager.cc:1397] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260806 04:45:10.442083 9269 tablet_bootstrap.cc:492] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48: No bootstrap required, opened a new log
I20260806 04:45:10.442354 9269 ts_tablet_manager.cc:1397] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 04:45:10.441618 9272 tablet_bootstrap.cc:492] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8: Bootstrap starting.
I20260806 04:45:10.445920 9272 tablet_bootstrap.cc:654] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:10.447081 9272 log.cc:824] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:10.450014 9272 tablet_bootstrap.cc:492] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8: No bootstrap required, opened a new log
I20260806 04:45:10.449935 9269 raft_consensus.cc:348] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.450268 9272 ts_tablet_manager.cc:1397] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 04:45:10.450316 9269 raft_consensus.cc:374] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:10.450425 9269 raft_consensus.cc:729] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60283b0c9d2f431fbb014cfdac9c6d48, State: Initialized, Role: FOLLOWER
I20260806 04:45:10.451023 9269 consensus_queue.cc:260] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.451859 9268 raft_consensus.cc:348] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.452234 9268 raft_consensus.cc:374] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:10.452575 9109 heartbeater.cc:503] Master 127.7.113.254:45091 was elected leader, sending a full tablet report...
I20260806 04:45:10.453033 9269 ts_tablet_manager.cc:1428] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260806 04:45:10.453177 9268 raft_consensus.cc:729] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb77314ac3354c069ecdb1cc35437ea7, State: Initialized, Role: FOLLOWER
I20260806 04:45:10.453912 9268 consensus_queue.cc:260] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.457077 9268 ts_tablet_manager.cc:1428] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7: Time spent starting tablet: real 0.016s user 0.008s sys 0.006s
I20260806 04:45:10.459960 9272 raft_consensus.cc:348] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.460403 9272 raft_consensus.cc:374] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:10.460501 9272 raft_consensus.cc:729] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d9631fb620c4de98a878cb4ac5381b8, State: Initialized, Role: FOLLOWER
I20260806 04:45:10.461091 9272 consensus_queue.cc:260] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.462723 9248 heartbeater.cc:503] Master 127.7.113.254:45091 was elected leader, sending a full tablet report...
I20260806 04:45:10.463101 9272 ts_tablet_manager.cc:1428] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
W20260806 04:45:10.544901 9110 tablet.cc:2369] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:45:10.545560 8970 tablet.cc:2369] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:45:10.567502 9249 tablet.cc:2369] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:45:10.782212 9276 raft_consensus.cc:482] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:10.782471 9276 raft_consensus.cc:504] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.784236 9276 leader_election.cc:288] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60283b0c9d2f431fbb014cfdac9c6d48 (127.7.113.194:34697), fb77314ac3354c069ecdb1cc35437ea7 (127.7.113.193:34835)
I20260806 04:45:10.792876 9265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.784778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:54187 (local address 127.7.113.193:34835)
0806 04:45:10.785001 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:10.785011 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:10.785810 (+ 799us) server_negotiation.cc:407] Connection header received
0806 04:45:10.785965 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:10.785973 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:10.786051 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:10.786163 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:10.786837 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.787562 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.789613 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.790359 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.790501 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.790588 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:10.792466 (+ 1878us) server_negotiation.cc:299] Negotiation successful
0806 04:45:10.792636 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 04:45:10.793094 9263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.784961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:49453 (local address 127.7.113.194:34697)
0806 04:45:10.785233 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:10.785240 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:10.785712 (+ 472us) server_negotiation.cc:407] Connection header received
0806 04:45:10.785800 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:10.785805 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:10.785888 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:10.785973 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:10.786650 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.787441 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.789339 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.790392 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.790581 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.790645 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:10.792669 (+ 2024us) server_negotiation.cc:299] Negotiation successful
0806 04:45:10.792875 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260806 04:45:10.793635 9277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.784695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:34835 (local address 127.7.113.195:54187)
0806 04:45:10.785442 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:10.785462 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:10.785821 (+ 359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:10.786210 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:10.786216 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:10.786252 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:10.786647 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:10.786659 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.787739 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.787744 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:10.789462 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:10.789476 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.791974 (+ 2498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.791981 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:10.792191 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.792246 (+ 55us) client_negotiation.cc:769] Sending connection context
0806 04:45:10.793072 (+ 826us) client_negotiation.cc:240] Negotiation successful
0806 04:45:10.793229 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"spinlock_wait_cycles":8448,"thread_start_us":439,"threads_started":1}
I20260806 04:45:10.793927 9278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.784843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:34697 (local address 127.7.113.195:49453)
0806 04:45:10.785479 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:10.785494 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:10.785680 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:10.786015 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:10.786020 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:10.786043 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:10.786462 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:10.786473 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.787575 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.787579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:10.789192 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:10.789203 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.792054 (+ 2851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.792064 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:10.792389 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.792455 (+ 66us) client_negotiation.cc:769] Sending connection context
0806 04:45:10.793357 (+ 902us) client_negotiation.cc:240] Negotiation successful
0806 04:45:10.793489 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"mutex_wait_us":56,"thread_start_us":391,"threads_started":1}
I20260806 04:45:10.794965 8923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52308721dac644feb58a59b6d90c2658" candidate_uuid: "7d9631fb620c4de98a878cb4ac5381b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb77314ac3354c069ecdb1cc35437ea7" is_pre_election: true
I20260806 04:45:10.794974 9063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52308721dac644feb58a59b6d90c2658" candidate_uuid: "7d9631fb620c4de98a878cb4ac5381b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" is_pre_election: true
I20260806 04:45:10.795550 9063 raft_consensus.cc:2454] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d9631fb620c4de98a878cb4ac5381b8 in term 0.
I20260806 04:45:10.795548 8923 raft_consensus.cc:2454] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d9631fb620c4de98a878cb4ac5381b8 in term 0.
I20260806 04:45:10.796383 9131 leader_election.cc:302] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 60283b0c9d2f431fbb014cfdac9c6d48, 7d9631fb620c4de98a878cb4ac5381b8, fb77314ac3354c069ecdb1cc35437ea7; no voters:
I20260806 04:45:10.797008 9276 raft_consensus.cc:2781] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:45:10.797143 9276 raft_consensus.cc:482] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:45:10.797233 9276 raft_consensus.cc:3037] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:10.800423 9276 raft_consensus.cc:504] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.801090 9276 leader_election.cc:288] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [CANDIDATE]: Term 1 election: Requested vote from peers 60283b0c9d2f431fbb014cfdac9c6d48 (127.7.113.194:34697), fb77314ac3354c069ecdb1cc35437ea7 (127.7.113.193:34835)
I20260806 04:45:10.801548 8923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52308721dac644feb58a59b6d90c2658" candidate_uuid: "7d9631fb620c4de98a878cb4ac5381b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb77314ac3354c069ecdb1cc35437ea7"
I20260806 04:45:10.801638 9063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52308721dac644feb58a59b6d90c2658" candidate_uuid: "7d9631fb620c4de98a878cb4ac5381b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60283b0c9d2f431fbb014cfdac9c6d48"
I20260806 04:45:10.801751 8923 raft_consensus.cc:3037] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:10.801872 9063 raft_consensus.cc:3037] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:10.804001 8923 raft_consensus.cc:2454] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d9631fb620c4de98a878cb4ac5381b8 in term 1.
I20260806 04:45:10.804412 9131 leader_election.cc:302] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d9631fb620c4de98a878cb4ac5381b8, fb77314ac3354c069ecdb1cc35437ea7; no voters:
I20260806 04:45:10.804663 9276 raft_consensus.cc:2781] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:10.805251 9063 raft_consensus.cc:2454] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d9631fb620c4de98a878cb4ac5381b8 in term 1.
I20260806 04:45:10.805367 9276 raft_consensus.cc:686] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [term 1 LEADER]: Becoming Leader. State: Replica: 7d9631fb620c4de98a878cb4ac5381b8, State: Running, Role: LEADER
I20260806 04:45:10.806047 9276 consensus_queue.cc:237] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.810242 8759 catalog_manager.cc:5495] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d9631fb620c4de98a878cb4ac5381b8 (127.7.113.195). New cstate: current_term: 1 leader_uuid: "7d9631fb620c4de98a878cb4ac5381b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260806 04:45:10.887600 9267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:10.881561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60912 (local address 127.7.113.195:34917)
0806 04:45:10.881819 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:10.881825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:10.882138 (+ 313us) server_negotiation.cc:407] Connection header received
0806 04:45:10.882473 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:10.882477 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:10.882555 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:10.882695 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:10.883165 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.883916 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.885348 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:10.885800 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:10.885934 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:10.886448 (+ 514us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:10.886942 (+ 494us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:10.887105 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:10.887233 (+ 128us) server_negotiation.cc:299] Negotiation successful
0806 04:45:10.887316 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 04:45:10.895372 8923 raft_consensus.cc:1261] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7 [term 1 FOLLOWER]: Refusing update from remote peer 7d9631fb620c4de98a878cb4ac5381b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:10.896509 9279 consensus_queue.cc:1035] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:10.897239 9063 raft_consensus.cc:1261] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 1 FOLLOWER]: Refusing update from remote peer 7d9631fb620c4de98a878cb4ac5381b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:10.898032 9279 consensus_queue.cc:1035] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:10.907487 9283 mvcc.cc:205] Tried to move back new op lower bound from 7315421228617023488 to 7315421228265250816. Current Snapshot: MvccSnapshot[applied={T|T < 7315421228617023488}]
I20260806 04:45:10.911347 9285 mvcc.cc:205] Tried to move back new op lower bound from 7315421228617023488 to 7315421228265250816. Current Snapshot: MvccSnapshot[applied={T|T < 7315421228617023488}]
I20260806 04:45:10.927600 8758 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:10.927917 8758 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:10.931551 8758 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3: Sending DeleteTablet for 3 replicas of tablet 52308721dac644feb58a59b6d90c2658
I20260806 04:45:10.932828 9038 tablet_service.cc:1514] Processing DeleteTablet for tablet 52308721dac644feb58a59b6d90c2658 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:10 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:43342
I20260806 04:45:10.933005 9178 tablet_service.cc:1514] Processing DeleteTablet for tablet 52308721dac644feb58a59b6d90c2658 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:10 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:40294
I20260806 04:45:10.933962 9292 tablet_replica.cc:330] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8: stopping tablet replica
I20260806 04:45:10.934054 8898 tablet_service.cc:1514] Processing DeleteTablet for tablet 52308721dac644feb58a59b6d90c2658 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:10 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:41274
I20260806 04:45:10.934507 9292 raft_consensus.cc:2229] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:45:10.935308 9292 raft_consensus.cc:2258] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:10.937845 9292 ts_tablet_manager.cc:1905] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:10.938172 8758 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35098:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:45:10.938804 8758 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:45:10.945958 9292 ts_tablet_manager.cc:1918] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:45:10.946120 9292 log.cc:1196] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/52308721dac644feb58a59b6d90c2658
I20260806 04:45:10.946681 9292 ts_tablet_manager.cc:1939] T 52308721dac644feb58a59b6d90c2658 P 7d9631fb620c4de98a878cb4ac5381b8: Deleting consensus metadata
I20260806 04:45:10.947965 9037 tablet_service.cc:1467] Processing CreateTablet for tablet d4a5e82462634b00af8ec9aa55d6ec32 (DEFAULT_TABLE table=test-table [id=95cd508eb79b4e558a4d476062ab082d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:10.947963 9178 tablet_service.cc:1467] Processing CreateTablet for tablet d4a5e82462634b00af8ec9aa55d6ec32 (DEFAULT_TABLE table=test-table [id=95cd508eb79b4e558a4d476062ab082d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:10.948412 9178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4a5e82462634b00af8ec9aa55d6ec32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:10.948448 9037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4a5e82462634b00af8ec9aa55d6ec32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:10.948931 9294 tablet_replica.cc:330] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7: stopping tablet replica
I20260806 04:45:10.949369 9294 raft_consensus.cc:2229] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:10.949856 9294 raft_consensus.cc:2258] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:10.951323 8898 tablet_service.cc:1467] Processing CreateTablet for tablet d4a5e82462634b00af8ec9aa55d6ec32 (DEFAULT_TABLE table=test-table [id=95cd508eb79b4e558a4d476062ab082d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:10.951804 8898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4a5e82462634b00af8ec9aa55d6ec32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:10.954834 9272 tablet_bootstrap.cc:492] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8: Bootstrap starting.
I20260806 04:45:10.956665 8743 catalog_manager.cc:4841] TS 7d9631fb620c4de98a878cb4ac5381b8 (127.7.113.195:34917): tablet 52308721dac644feb58a59b6d90c2658 (table test-table [id=52a09faceb314fd08531dc7446a4e876]) successfully deleted
I20260806 04:45:10.956820 9272 tablet_bootstrap.cc:654] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:10.957027 9295 tablet_bootstrap.cc:492] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48: Bootstrap starting.
I20260806 04:45:10.958956 9295 tablet_bootstrap.cc:654] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:10.964800 9293 tablet_replica.cc:330] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48: stopping tablet replica
I20260806 04:45:10.964112 9294 ts_tablet_manager.cc:1905] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:10.971206 9272 tablet_bootstrap.cc:492] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8: No bootstrap required, opened a new log
I20260806 04:45:10.971372 9272 ts_tablet_manager.cc:1397] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.009s
I20260806 04:45:10.971876 9293 raft_consensus.cc:2229] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:10.972486 9293 raft_consensus.cc:2258] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:10.972355 9272 raft_consensus.cc:348] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.972584 9272 raft_consensus.cc:374] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:10.972704 9272 raft_consensus.cc:729] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d9631fb620c4de98a878cb4ac5381b8, State: Initialized, Role: FOLLOWER
I20260806 04:45:10.973030 9272 consensus_queue.cc:260] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.974021 9298 tablet_bootstrap.cc:492] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7: Bootstrap starting.
I20260806 04:45:10.975056 9293 ts_tablet_manager.cc:1905] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:10.975981 9272 ts_tablet_manager.cc:1428] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260806 04:45:10.976022 9298 tablet_bootstrap.cc:654] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:10.979969 9294 ts_tablet_manager.cc:1918] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:45:10.980225 9294 log.cc:1196] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/52308721dac644feb58a59b6d90c2658
I20260806 04:45:10.980693 9298 tablet_bootstrap.cc:492] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7: No bootstrap required, opened a new log
I20260806 04:45:10.980844 9298 ts_tablet_manager.cc:1397] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.003s
I20260806 04:45:10.981436 9294 ts_tablet_manager.cc:1939] T 52308721dac644feb58a59b6d90c2658 P fb77314ac3354c069ecdb1cc35437ea7: Deleting consensus metadata
I20260806 04:45:10.981633 9295 tablet_bootstrap.cc:492] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48: No bootstrap required, opened a new log
I20260806 04:45:10.981812 9295 ts_tablet_manager.cc:1397] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.012s
I20260806 04:45:10.981762 9298 raft_consensus.cc:348] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.982003 9298 raft_consensus.cc:374] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:10.982113 9298 raft_consensus.cc:729] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb77314ac3354c069ecdb1cc35437ea7, State: Initialized, Role: FOLLOWER
I20260806 04:45:10.982381 9298 consensus_queue.cc:260] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.982584 9295 raft_consensus.cc:348] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.982837 9295 raft_consensus.cc:374] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:10.982924 9295 raft_consensus.cc:729] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60283b0c9d2f431fbb014cfdac9c6d48, State: Initialized, Role: FOLLOWER
I20260806 04:45:10.983083 9298 ts_tablet_manager.cc:1428] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 04:45:10.983206 9295 consensus_queue.cc:260] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:10.983780 9295 ts_tablet_manager.cc:1428] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260806 04:45:10.985283 8745 catalog_manager.cc:4841] TS fb77314ac3354c069ecdb1cc35437ea7 (127.7.113.193:34835): tablet 52308721dac644feb58a59b6d90c2658 (table test-table [id=52a09faceb314fd08531dc7446a4e876]) successfully deleted
I20260806 04:45:10.985993 9293 ts_tablet_manager.cc:1918] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:45:10.986130 9293 log.cc:1196] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/52308721dac644feb58a59b6d90c2658
I20260806 04:45:10.986698 9293 ts_tablet_manager.cc:1939] T 52308721dac644feb58a59b6d90c2658 P 60283b0c9d2f431fbb014cfdac9c6d48: Deleting consensus metadata
I20260806 04:45:10.988346 8744 catalog_manager.cc:4841] TS 60283b0c9d2f431fbb014cfdac9c6d48 (127.7.113.194:34697): tablet 52308721dac644feb58a59b6d90c2658 (table test-table [id=52a09faceb314fd08531dc7446a4e876]) successfully deleted
I20260806 04:45:11.279462 9275 raft_consensus.cc:482] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:11.279748 9275 raft_consensus.cc:504] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:11.281450 9275 leader_election.cc:288] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60283b0c9d2f431fbb014cfdac9c6d48 (127.7.113.194:34697), 7d9631fb620c4de98a878cb4ac5381b8 (127.7.113.195:34917)
I20260806 04:45:11.291029 9263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.282501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:38679 (local address 127.7.113.194:34697)
0806 04:45:11.282700 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:11.282707 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:11.283809 (+ 1102us) server_negotiation.cc:407] Connection header received
0806 04:45:11.284024 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:11.284027 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:11.284085 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:11.284185 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:11.284750 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.285475 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.288533 (+ 3058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.289823 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.289986 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.290069 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:11.290463 (+ 394us) server_negotiation.cc:299] Negotiation successful
0806 04:45:11.290629 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 04:45:11.291966 9301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.281800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:34697 (local address 127.7.113.193:38679)
0806 04:45:11.283573 (+ 1773us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:11.283589 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:11.283867 (+ 278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:11.284234 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:11.284239 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:11.284289 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:11.284611 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:11.284624 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.285603 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.285612 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:11.288369 (+ 2757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:11.288383 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.290021 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.290026 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:11.290254 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.290293 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 04:45:11.291444 (+ 1151us) client_negotiation.cc:240] Negotiation successful
0806 04:45:11.291588 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1629,"mutex_wait_us":192,"thread_start_us":1678,"threads_started":1}
I20260806 04:45:11.292822 9063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4a5e82462634b00af8ec9aa55d6ec32" candidate_uuid: "fb77314ac3354c069ecdb1cc35437ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" is_pre_election: true
I20260806 04:45:11.293061 9302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.281759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:34917 (local address 127.7.113.193:33861)
0806 04:45:11.282615 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:11.282641 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:11.282933 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:11.283648 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:11.283653 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:11.283698 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:11.284088 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:11.284102 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.285680 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.285684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:11.288369 (+ 2685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:11.288383 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.292125 (+ 3742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.292133 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:11.292386 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.292422 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 04:45:11.292523 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 04:45:11.292649 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"mutex_wait_us":170,"thread_start_us":1532,"threads_started":1}
I20260806 04:45:11.293087 9063 raft_consensus.cc:2454] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb77314ac3354c069ecdb1cc35437ea7 in term 0.
I20260806 04:45:11.293711 9267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.281950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:33861 (local address 127.7.113.195:34917)
0806 04:45:11.282322 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:11.282328 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:11.283098 (+ 770us) server_negotiation.cc:407] Connection header received
0806 04:45:11.283186 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:11.283192 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:11.283308 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:11.283449 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:11.284313 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.285537 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.290162 (+ 4625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.291708 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.291866 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.291951 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:11.293253 (+ 1302us) server_negotiation.cc:299] Negotiation successful
0806 04:45:11.293396 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232}
I20260806 04:45:11.293809 8848 leader_election.cc:302] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60283b0c9d2f431fbb014cfdac9c6d48, fb77314ac3354c069ecdb1cc35437ea7; no voters:
I20260806 04:45:11.294237 9275 raft_consensus.cc:2781] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:45:11.294351 9275 raft_consensus.cc:482] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:45:11.294431 9275 raft_consensus.cc:3037] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:11.294930 9198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4a5e82462634b00af8ec9aa55d6ec32" candidate_uuid: "fb77314ac3354c069ecdb1cc35437ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d9631fb620c4de98a878cb4ac5381b8" is_pre_election: true
I20260806 04:45:11.295308 9198 raft_consensus.cc:2454] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb77314ac3354c069ecdb1cc35437ea7 in term 0.
I20260806 04:45:11.297472 9275 raft_consensus.cc:504] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:11.298095 9275 leader_election.cc:288] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [CANDIDATE]: Term 1 election: Requested vote from peers 60283b0c9d2f431fbb014cfdac9c6d48 (127.7.113.194:34697), 7d9631fb620c4de98a878cb4ac5381b8 (127.7.113.195:34917)
I20260806 04:45:11.298471 9063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4a5e82462634b00af8ec9aa55d6ec32" candidate_uuid: "fb77314ac3354c069ecdb1cc35437ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60283b0c9d2f431fbb014cfdac9c6d48"
I20260806 04:45:11.298677 9063 raft_consensus.cc:3037] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:11.300683 9063 raft_consensus.cc:2454] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb77314ac3354c069ecdb1cc35437ea7 in term 1.
I20260806 04:45:11.301277 8848 leader_election.cc:302] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60283b0c9d2f431fbb014cfdac9c6d48, fb77314ac3354c069ecdb1cc35437ea7; no voters:
I20260806 04:45:11.301566 9275 raft_consensus.cc:2781] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:11.301685 9198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4a5e82462634b00af8ec9aa55d6ec32" candidate_uuid: "fb77314ac3354c069ecdb1cc35437ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d9631fb620c4de98a878cb4ac5381b8"
I20260806 04:45:11.301904 9198 raft_consensus.cc:3037] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:11.306380 9198 raft_consensus.cc:2454] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb77314ac3354c069ecdb1cc35437ea7 in term 1.
I20260806 04:45:11.307314 9275 raft_consensus.cc:686] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [term 1 LEADER]: Becoming Leader. State: Replica: fb77314ac3354c069ecdb1cc35437ea7, State: Running, Role: LEADER
I20260806 04:45:11.307724 9275 consensus_queue.cc:237] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:11.311275 8759 catalog_manager.cc:5495] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb77314ac3354c069ecdb1cc35437ea7 (127.7.113.193). New cstate: current_term: 1 leader_uuid: "fb77314ac3354c069ecdb1cc35437ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } health_report { overall_health: UNKNOWN } } }
Aug 06 04:45:11 dist-test-slave-0b58 krb5kdc[8714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991508, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:11.376302 9311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.363113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45091 (local address 127.0.0.1:42916)
0806 04:45:11.364042 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:11.364058 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:11.364180 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:11.364528 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:11.364531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:11.365209 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:11.365477 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:11.365486 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.366571 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.366575 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:11.367533 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:11.367543 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.368228 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.368232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:11.368400 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.369084 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:11.369100 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:11.371161 (+ 2061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:11.374011 (+ 2850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:11.374022 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:11.374027 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:11.374478 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:11.374797 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:11.374800 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:11.374802 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:11.374947 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:11.375417 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:11.375422 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:11.375591 (+ 169us) client_negotiation.cc:769] Sending connection context
0806 04:45:11.375740 (+ 149us) client_negotiation.cc:240] Negotiation successful
0806 04:45:11.375928 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":760,"thread_start_us":611,"threads_started":1}
I20260806 04:45:11.376389 9310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.362860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42916 (local address 127.7.113.254:45091)
0806 04:45:11.363728 (+ 868us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:11.363732 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:11.364133 (+ 401us) server_negotiation.cc:407] Connection header received
0806 04:45:11.364310 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:11.364314 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:11.364381 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:11.364479 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:11.365628 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.366450 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.367645 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.368073 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.368175 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.371369 (+ 3194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:11.371374 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:11.371377 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:11.371403 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:11.373878 (+ 2475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:11.374591 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:11.374595 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:11.374597 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:11.374706 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:11.375034 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:11.375037 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:11.375038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:11.375281 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:11.375385 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:11.375814 (+ 429us) server_negotiation.cc:299] Negotiation successful
0806 04:45:11.376047 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":75,"server-negotiator.queue_time_us":767,"thread_start_us":518,"threads_started":1}
I20260806 04:45:11.381422 8759 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:42916:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 04:45:11.382459 8759 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:45:11.389281 8898 tablet_service.cc:1467] Processing CreateTablet for tablet ea6f22729a984ba6858b00e8b4312168 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=df6227dcdad54e21a27b06b269ca7af9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 04:45:11.389446 9038 tablet_service.cc:1467] Processing CreateTablet for tablet ea6f22729a984ba6858b00e8b4312168 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=df6227dcdad54e21a27b06b269ca7af9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 04:45:11.389663 9178 tablet_service.cc:1467] Processing CreateTablet for tablet ea6f22729a984ba6858b00e8b4312168 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=df6227dcdad54e21a27b06b269ca7af9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 04:45:11.389891 8898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6f22729a984ba6858b00e8b4312168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:11.390030 9038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6f22729a984ba6858b00e8b4312168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:11.390173 9178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6f22729a984ba6858b00e8b4312168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:11.395233 9295 tablet_bootstrap.cc:492] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48: Bootstrap starting.
I20260806 04:45:11.396626 9295 tablet_bootstrap.cc:654] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:11.396992 9272 tablet_bootstrap.cc:492] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8: Bootstrap starting.
I20260806 04:45:11.397029 9298 tablet_bootstrap.cc:492] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7: Bootstrap starting.
I20260806 04:45:11.398720 9272 tablet_bootstrap.cc:654] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:11.398762 9298 tablet_bootstrap.cc:654] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:11.398885 9295 tablet_bootstrap.cc:492] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48: No bootstrap required, opened a new log
I20260806 04:45:11.399060 9295 ts_tablet_manager.cc:1397] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 04:45:11.399859 9295 raft_consensus.cc:348] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:11.400245 9295 raft_consensus.cc:374] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:11.400422 9295 raft_consensus.cc:729] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60283b0c9d2f431fbb014cfdac9c6d48, State: Initialized, Role: FOLLOWER
I20260806 04:45:11.400774 9295 consensus_queue.cc:260] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:11.401002 9298 tablet_bootstrap.cc:492] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7: No bootstrap required, opened a new log
I20260806 04:45:11.401077 9272 tablet_bootstrap.cc:492] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8: No bootstrap required, opened a new log
I20260806 04:45:11.401172 9298 ts_tablet_manager.cc:1397] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260806 04:45:11.401316 9272 ts_tablet_manager.cc:1397] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.001s
I20260806 04:45:11.401412 9274 tablet_replica.cc:439] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } } }
I20260806 04:45:11.401813 9274 tablet_replica.cc:442] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:45:11.401914 9298 raft_consensus.cc:348] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:11.402189 9298 raft_consensus.cc:374] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:11.402246 9298 raft_consensus.cc:729] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb77314ac3354c069ecdb1cc35437ea7, State: Initialized, Role: FOLLOWER
I20260806 04:45:11.402318 9295 ts_tablet_manager.cc:1428] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 04:45:11.402485 9298 consensus_queue.cc:260] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:11.403098 9298 ts_tablet_manager.cc:1428] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 04:45:11.402982 9275 tablet_replica.cc:439] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } } }
I20260806 04:45:11.403281 9275 tablet_replica.cc:442] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:45:11.402606 9272 raft_consensus.cc:348] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:11.404359 9272 raft_consensus.cc:374] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:11.404488 9272 raft_consensus.cc:729] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d9631fb620c4de98a878cb4ac5381b8, State: Initialized, Role: FOLLOWER
I20260806 04:45:11.404763 9272 consensus_queue.cc:260] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:11.405409 9272 ts_tablet_manager.cc:1428] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260806 04:45:11.405282 9276 tablet_replica.cc:439] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } } }
I20260806 04:45:11.405630 9276 tablet_replica.cc:442] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:45:11.483043 9275 raft_consensus.cc:482] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:11.483363 9275 raft_consensus.cc:504] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:11.484001 9275 leader_election.cc:288] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60283b0c9d2f431fbb014cfdac9c6d48 (127.7.113.194:34697), 7d9631fb620c4de98a878cb4ac5381b8 (127.7.113.195:34917)
I20260806 04:45:11.484608 9063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6f22729a984ba6858b00e8b4312168" candidate_uuid: "fb77314ac3354c069ecdb1cc35437ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" is_pre_election: true
I20260806 04:45:11.484601 9198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6f22729a984ba6858b00e8b4312168" candidate_uuid: "fb77314ac3354c069ecdb1cc35437ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d9631fb620c4de98a878cb4ac5381b8" is_pre_election: true
I20260806 04:45:11.484884 9063 raft_consensus.cc:2454] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb77314ac3354c069ecdb1cc35437ea7 in term 0.
I20260806 04:45:11.484887 9198 raft_consensus.cc:2454] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb77314ac3354c069ecdb1cc35437ea7 in term 0.
I20260806 04:45:11.485357 8848 leader_election.cc:302] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60283b0c9d2f431fbb014cfdac9c6d48, fb77314ac3354c069ecdb1cc35437ea7; no voters:
I20260806 04:45:11.485687 9275 raft_consensus.cc:2781] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:45:11.485772 9275 raft_consensus.cc:482] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:45:11.485941 9275 raft_consensus.cc:3037] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:11.488075 9275 raft_consensus.cc:504] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:11.488744 9275 leader_election.cc:288] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [CANDIDATE]: Term 1 election: Requested vote from peers 60283b0c9d2f431fbb014cfdac9c6d48 (127.7.113.194:34697), 7d9631fb620c4de98a878cb4ac5381b8 (127.7.113.195:34917)
I20260806 04:45:11.489236 9198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6f22729a984ba6858b00e8b4312168" candidate_uuid: "fb77314ac3354c069ecdb1cc35437ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d9631fb620c4de98a878cb4ac5381b8"
I20260806 04:45:11.489260 9063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6f22729a984ba6858b00e8b4312168" candidate_uuid: "fb77314ac3354c069ecdb1cc35437ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60283b0c9d2f431fbb014cfdac9c6d48"
I20260806 04:45:11.489457 9198 raft_consensus.cc:3037] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:11.489491 9063 raft_consensus.cc:3037] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:11.491309 9198 raft_consensus.cc:2454] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb77314ac3354c069ecdb1cc35437ea7 in term 1.
I20260806 04:45:11.491398 9063 raft_consensus.cc:2454] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb77314ac3354c069ecdb1cc35437ea7 in term 1.
I20260806 04:45:11.491781 8847 leader_election.cc:302] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d9631fb620c4de98a878cb4ac5381b8, fb77314ac3354c069ecdb1cc35437ea7; no voters:
I20260806 04:45:11.492154 9275 raft_consensus.cc:2781] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:11.492388 9275 raft_consensus.cc:686] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [term 1 LEADER]: Becoming Leader. State: Replica: fb77314ac3354c069ecdb1cc35437ea7, State: Running, Role: LEADER
I20260806 04:45:11.492682 9275 consensus_queue.cc:237] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } }
I20260806 04:45:11.494088 9303 tablet_replica.cc:439] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7: TxnStatusTablet state changed. Reason: New leader fb77314ac3354c069ecdb1cc35437ea7. Latest consensus state: current_term: 1 leader_uuid: "fb77314ac3354c069ecdb1cc35437ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } } }
I20260806 04:45:11.494408 9303 tablet_replica.cc:442] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7: This TxnStatusTablet replica's current role is: LEADER
I20260806 04:45:11.495325 8759 catalog_manager.cc:5495] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb77314ac3354c069ecdb1cc35437ea7 (127.7.113.193). New cstate: current_term: 1 leader_uuid: "fb77314ac3354c069ecdb1cc35437ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260806 04:45:11.495765 9316 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 04:45:11.496044 9316 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 04:45:11.535660 9311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.529426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:34835 (local address 127.0.0.1:47232)
0806 04:45:11.529665 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:11.529690 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:11.529868 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:11.530635 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:11.530640 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:11.530664 (+ 24us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 04:45:11.530870 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:11.530882 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.532110 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.532116 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:11.533183 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:11.533195 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.533968 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.533974 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:11.534179 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.534231 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 04:45:11.535076 (+ 845us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 04:45:11.535100 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 04:45:11.535186 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 04:45:11.535335 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 04:45:11.535768 9319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.529502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47232 (local address 127.7.113.193:34835)
0806 04:45:11.530167 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:11.530173 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:11.530197 (+ 24us) server_negotiation.cc:407] Connection header received
0806 04:45:11.530268 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:11.530272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:11.530344 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:11.530612 (+ 268us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:11.531039 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.531965 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.533355 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.533825 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.533966 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.534436 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:11.534957 (+ 521us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:11.535124 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:11.535249 (+ 125us) server_negotiation.cc:299] Negotiation successful
0806 04:45:11.535324 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":331,"threads_started":1}
I20260806 04:45:11.540910 9063 raft_consensus.cc:1261] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 1 FOLLOWER]: Refusing update from remote peer fb77314ac3354c069ecdb1cc35437ea7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:11.541152 9198 raft_consensus.cc:1261] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8 [term 1 FOLLOWER]: Refusing update from remote peer fb77314ac3354c069ecdb1cc35437ea7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:11.541699 9303 consensus_queue.cc:1035] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:11.542402 9275 consensus_queue.cc:1035] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:11.553107 9276 tablet_replica.cc:439] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8: TxnStatusTablet state changed. Reason: New leader fb77314ac3354c069ecdb1cc35437ea7. Latest consensus state: current_term: 1 leader_uuid: "fb77314ac3354c069ecdb1cc35437ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } } }
I20260806 04:45:11.553442 9276 tablet_replica.cc:442] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:45:11.553256 9274 tablet_replica.cc:439] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48: TxnStatusTablet state changed. Reason: New leader fb77314ac3354c069ecdb1cc35437ea7. Latest consensus state: current_term: 1 leader_uuid: "fb77314ac3354c069ecdb1cc35437ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } } }
I20260806 04:45:11.553529 9274 tablet_replica.cc:442] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:45:11.554709 9320 mvcc.cc:205] Tried to move back new op lower bound from 7315421231264530432 to 7315421231075926016. Current Snapshot: MvccSnapshot[applied={T|T < 7315421231264530432}]
I20260806 04:45:11.555923 9275 tablet_replica.cc:439] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fb77314ac3354c069ecdb1cc35437ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } } }
I20260806 04:45:11.556218 9275 tablet_replica.cc:442] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7: This TxnStatusTablet replica's current role is: LEADER
I20260806 04:45:11.558815 9276 tablet_replica.cc:439] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fb77314ac3354c069ecdb1cc35437ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } } }
I20260806 04:45:11.559078 9276 tablet_replica.cc:442] T ea6f22729a984ba6858b00e8b4312168 P 7d9631fb620c4de98a878cb4ac5381b8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:45:11.560565 9303 tablet_replica.cc:439] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fb77314ac3354c069ecdb1cc35437ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } } }
I20260806 04:45:11.560806 9303 tablet_replica.cc:442] T ea6f22729a984ba6858b00e8b4312168 P fb77314ac3354c069ecdb1cc35437ea7: This TxnStatusTablet replica's current role is: LEADER
I20260806 04:45:11.565536 9274 tablet_replica.cc:439] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fb77314ac3354c069ecdb1cc35437ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb77314ac3354c069ecdb1cc35437ea7" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34835 } } peers { permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 } } peers { permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 } } }
I20260806 04:45:11.565795 9274 tablet_replica.cc:442] T ea6f22729a984ba6858b00e8b4312168 P 60283b0c9d2f431fbb014cfdac9c6d48: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:45:11.573426 9319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.565651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47240 (local address 127.7.113.193:34835)
0806 04:45:11.565822 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:11.565828 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:11.567626 (+ 1798us) server_negotiation.cc:407] Connection header received
0806 04:45:11.567906 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:11.567911 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:11.567984 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:11.568085 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:11.568562 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.569441 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.571432 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.571904 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.571998 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.572515 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:11.572615 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:11.572700 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:11.572885 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 04:45:11.572950 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 04:45:11.590075 9319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.584081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:34103 (local address 127.7.113.193:34835)
0806 04:45:11.584249 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:11.584297 (+ 48us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:11.585165 (+ 868us) server_negotiation.cc:407] Connection header received
0806 04:45:11.585355 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:11.585360 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:11.585448 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:11.585546 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:11.586088 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.586849 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.588282 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.588724 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.588861 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.589298 (+ 437us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:11.589390 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:11.589481 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:11.589614 (+ 133us) server_negotiation.cc:299] Negotiation successful
0806 04:45:11.589674 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":49}
I20260806 04:45:11.590206 9333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.584201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:34835 (local address 127.7.113.193:34103)
0806 04:45:11.584913 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:11.584929 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:11.585228 (+ 299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:11.585549 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:11.585553 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:11.585563 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 04:45:11.585922 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:11.585930 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.586973 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.586981 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:11.588119 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:11.588130 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.588912 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.588920 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:11.589068 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.589124 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 04:45:11.589481 (+ 357us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 04:45:11.589493 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 04:45:11.589593 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 04:45:11.589719 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"mutex_wait_us":27,"thread_start_us":413,"threads_started":1}
I20260806 04:45:11.600466 9198 raft_consensus.cc:1261] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8 [term 1 FOLLOWER]: Refusing update from remote peer fb77314ac3354c069ecdb1cc35437ea7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:11.600483 9063 raft_consensus.cc:1261] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 1 FOLLOWER]: Refusing update from remote peer fb77314ac3354c069ecdb1cc35437ea7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:11.601001 9303 consensus_queue.cc:1035] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60283b0c9d2f431fbb014cfdac9c6d48" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 34697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:11.601343 9334 consensus_queue.cc:1035] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d9631fb620c4de98a878cb4ac5381b8" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:11.670121 8759 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:11.670413 8759 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:11.673409 8759 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1de3c62c44ab42858ca5b517555ff0a3: Sending DeleteTablet for 3 replicas of tablet d4a5e82462634b00af8ec9aa55d6ec32
I20260806 04:45:11.674093 8898 tablet_service.cc:1514] Processing DeleteTablet for tablet d4a5e82462634b00af8ec9aa55d6ec32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:11 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:41274
I20260806 04:45:11.674338 9038 tablet_service.cc:1514] Processing DeleteTablet for tablet d4a5e82462634b00af8ec9aa55d6ec32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:11 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:43342
I20260806 04:45:11.674710 9178 tablet_service.cc:1514] Processing DeleteTablet for tablet d4a5e82462634b00af8ec9aa55d6ec32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:11 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:40294
I20260806 04:45:11.682657 9341 tablet_replica.cc:330] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8: stopping tablet replica
I20260806 04:45:11.683413 9341 raft_consensus.cc:2229] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:11.684505 9341 raft_consensus.cc:2258] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:11.685660 9340 tablet_replica.cc:330] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48: stopping tablet replica
I20260806 04:45:11.685882 9340 raft_consensus.cc:2229] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:11.686131 9339 tablet_replica.cc:330] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7: stopping tablet replica
I20260806 04:45:11.686173 9340 raft_consensus.cc:2258] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:11.686388 9339 raft_consensus.cc:2229] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:45:11.686483 9341 ts_tablet_manager.cc:1905] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:11.687062 9339 raft_consensus.cc:2258] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:11.687572 9340 ts_tablet_manager.cc:1905] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:11.694068 9341 ts_tablet_manager.cc:1918] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:45:11.694265 9341 log.cc:1196] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/d4a5e82462634b00af8ec9aa55d6ec32
I20260806 04:45:11.694540 9340 ts_tablet_manager.cc:1918] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:45:11.694692 9340 log.cc:1196] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/d4a5e82462634b00af8ec9aa55d6ec32
I20260806 04:45:11.694854 9341 ts_tablet_manager.cc:1939] T d4a5e82462634b00af8ec9aa55d6ec32 P 7d9631fb620c4de98a878cb4ac5381b8: Deleting consensus metadata
I20260806 04:45:11.695187 9340 ts_tablet_manager.cc:1939] T d4a5e82462634b00af8ec9aa55d6ec32 P 60283b0c9d2f431fbb014cfdac9c6d48: Deleting consensus metadata
I20260806 04:45:11.695905 8743 catalog_manager.cc:4841] TS 7d9631fb620c4de98a878cb4ac5381b8 (127.7.113.195:34917): tablet d4a5e82462634b00af8ec9aa55d6ec32 (table test-table [id=95cd508eb79b4e558a4d476062ab082d]) successfully deleted
I20260806 04:45:11.696846 9339 ts_tablet_manager.cc:1905] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 04:45:11 dist-test-slave-0b58 krb5kdc[8714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991510, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:45:11.705214 9339 ts_tablet_manager.cc:1918] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:45:11.705374 9339 log.cc:1196] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/d4a5e82462634b00af8ec9aa55d6ec32
I20260806 04:45:11.705869 9339 ts_tablet_manager.cc:1939] T d4a5e82462634b00af8ec9aa55d6ec32 P fb77314ac3354c069ecdb1cc35437ea7: Deleting consensus metadata
I20260806 04:45:11.707110 8745 catalog_manager.cc:4841] TS fb77314ac3354c069ecdb1cc35437ea7 (127.7.113.193:34835): tablet d4a5e82462634b00af8ec9aa55d6ec32 (table test-table [id=95cd508eb79b4e558a4d476062ab082d]) successfully deleted
I20260806 04:45:11.707767 8744 catalog_manager.cc:4841] TS 60283b0c9d2f431fbb014cfdac9c6d48 (127.7.113.194:34697): tablet d4a5e82462634b00af8ec9aa55d6ec32 (table test-table [id=95cd508eb79b4e558a4d476062ab082d]) successfully deleted
I20260806 04:45:11.709422 9319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.685616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47252 (local address 127.7.113.193:34835)
0806 04:45:11.685802 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:11.685808 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:11.687939 (+ 2131us) server_negotiation.cc:407] Connection header received
0806 04:45:11.688250 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:11.688278 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:11.688370 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:11.688444 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:11.690605 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.691745 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.693774 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.694528 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.694631 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.700509 (+ 5878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:11.700525 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:11.700544 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:11.700607 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:11.704890 (+ 4283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:11.706110 (+ 1220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:11.706121 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:11.706124 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:11.706319 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:11.706833 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:11.706840 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:11.706843 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:11.707398 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:11.708129 (+ 731us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:11.708707 (+ 578us) server_negotiation.cc:299] Negotiation successful
0806 04:45:11.708942 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260806 04:45:11.710242 8964 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47252
I20260806 04:45:11.727720 9310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.713730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42920 (local address 127.7.113.254:45091)
0806 04:45:11.713933 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:11.713940 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:11.714439 (+ 499us) server_negotiation.cc:407] Connection header received
0806 04:45:11.714643 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:11.714649 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:11.714751 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:11.714861 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:11.716457 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.717409 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.718888 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.719568 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.719718 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.722060 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:11.722067 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:11.722071 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:11.722122 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:11.725057 (+ 2935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:11.725744 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:11.725751 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:11.725755 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:11.725889 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:11.726281 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:11.726287 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:11.726291 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:11.726612 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:11.726876 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:11.727196 (+ 320us) server_negotiation.cc:299] Negotiation successful
0806 04:45:11.727418 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260806 04:45:11.728319 8759 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42920
I20260806 04:45:11.730582 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 8831
I20260806 04:45:11.744589 9319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.731419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47254 (local address 127.7.113.193:34835)
0806 04:45:11.731806 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:11.731815 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:11.732413 (+ 598us) server_negotiation.cc:407] Connection header received
0806 04:45:11.732598 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:11.732604 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:11.732689 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:11.732801 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:11.733928 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.734724 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.736037 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.736605 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.736778 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.738950 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:11.738960 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:11.738964 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:11.738995 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:11.741885 (+ 2890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:11.742568 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:11.742573 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:11.742578 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:11.742734 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:11.743114 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:11.743118 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:11.743124 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:11.743407 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:11.743643 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:11.743995 (+ 352us) server_negotiation.cc:299] Negotiation successful
0806 04:45:11.744240 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212}
W20260806 04:45:11.745174 8964 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47254
W20260806 04:45:11.745785 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 8831: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:45:11.745997 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 8831
I20260806 04:45:11.767474 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 8973
Aug 06 04:45:11 dist-test-slave-0b58 krb5kdc[8714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991510, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:45:11.782332 9263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.768192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41666 (local address 127.7.113.194:34697)
0806 04:45:11.768409 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:11.768417 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:11.768456 (+ 39us) server_negotiation.cc:407] Connection header received
0806 04:45:11.768693 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:11.768697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:11.768776 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:11.768888 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:11.770063 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.770779 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.772000 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.772479 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.772622 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.776646 (+ 4024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:11.776658 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:11.776673 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:11.776711 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:11.779318 (+ 2607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:11.779970 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:11.779978 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:11.779980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:11.780117 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:11.780720 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:11.780727 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:11.780730 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:11.781144 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:11.781463 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:11.781782 (+ 319us) server_negotiation.cc:299] Negotiation successful
0806 04:45:11.782012 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
W20260806 04:45:11.783005 9104 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41666
W20260806 04:45:11.783715 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 8973: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:45:11.783924 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 8973
I20260806 04:45:11.802642 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 9113
Aug 06 04:45:11 dist-test-slave-0b58 krb5kdc[8714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991510, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:45:11.817409 9347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:11.803339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60924 (local address 127.7.113.195:34917)
0806 04:45:11.803847 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:11.803851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:11.803866 (+ 15us) server_negotiation.cc:407] Connection header received
0806 04:45:11.803916 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:11.803919 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:11.803976 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:11.804092 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:11.805342 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.806103 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.807334 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:11.807756 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:11.807889 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:11.812022 (+ 4133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:11.812036 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:11.812053 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:11.812088 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:11.814923 (+ 2835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:11.815605 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:11.815612 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:11.815614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:11.815767 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:11.816126 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:11.816129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:11.816131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:11.816530 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:11.816757 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:11.816988 (+ 231us) server_negotiation.cc:299] Negotiation successful
0806 04:45:11.817153 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":242,"threads_started":1}
W20260806 04:45:11.818048 9243 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60924
W20260806 04:45:11.818697 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 9113: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:45:11.818827 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 9113
I20260806 04:45:11.842478 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 8727
I20260806 04:45:11.843590 8799 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:11.957352 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 8727
2026-08-06T04:45:11Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5014 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:45:12 dist-test-slave-0b58 krb5kdc[9351](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:45:12 dist-test-slave-0b58 krb5kdc[9351](info): set up 2 sockets
Aug 06 04:45:12 dist-test-slave-0b58 krb5kdc[9351](info): commencing operation
krb5kdc: starting...
W20260806 04:45:13.042830 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.003s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:45:13 dist-test-slave-0b58 krb5kdc[9351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:45:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:45:13.247121 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:38139
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:43435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:38139
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:13.563670 9365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:13.564002 9365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:13.564165 9365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:13.571352 9365 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:13.571491 9365 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 04:45:13.571583 9365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:13.571707 9365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:13.571794 9365 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:13.571887 9365 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:45:13.581697 9365 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:43435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:38139
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:38139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:13.582926 9365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:13.584240 9365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:13.596062 9373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:13.596032 9370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:13.596139 9371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:13.597157 9365 server_base.cc:1034] running on GCE node
I20260806 04:45:13.597828 9365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:13.599123 9365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:13.600381 9365 hybrid_clock.cc:648] HybridClock initialized: now 1785991513600300 us; error 44 us; skew 500 ppm
I20260806 04:45:13.600713 9365 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:13 dist-test-slave-0b58 krb5kdc[9351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991513, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:13.610183 9365 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:45:13.611666 9365 webserver.cc:460] Webserver started at http://127.7.113.254:43487/ using document root <none> and password file <none>
I20260806 04:45:13.612406 9365 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:13.612504 9365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:13.612769 9365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:13.615787 9365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "3cd6b3ae1df74366aebd11989041e304"
format_stamp: "Formatted at 2026-08-06 04:45:13 on dist-test-slave-0b58"
server_key: "d668898741060515c7b0ffd016bbf10b"
server_key_iv: "2067277524822d4ee9b59e910319397e"
server_key_version: "encryptionkey@0"
I20260806 04:45:13.616566 9365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "3cd6b3ae1df74366aebd11989041e304"
format_stamp: "Formatted at 2026-08-06 04:45:13 on dist-test-slave-0b58"
server_key: "d668898741060515c7b0ffd016bbf10b"
server_key_iv: "2067277524822d4ee9b59e910319397e"
server_key_version: "encryptionkey@0"
I20260806 04:45:13.621840 9365 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:45:13.625236 9380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:13.626655 9365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:45:13.626806 9365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "3cd6b3ae1df74366aebd11989041e304"
format_stamp: "Formatted at 2026-08-06 04:45:13 on dist-test-slave-0b58"
server_key: "d668898741060515c7b0ffd016bbf10b"
server_key_iv: "2067277524822d4ee9b59e910319397e"
server_key_version: "encryptionkey@0"
I20260806 04:45:13.626986 9365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:13.637651 9365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:13.641607 9365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:13.641877 9365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:13.664448 9365 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:38139
I20260806 04:45:13.664426 9442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:38139 every 8 connection(s)
I20260806 04:45:13.665813 9365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:13.669770 9443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:13.674448 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 9365
I20260806 04:45:13.674675 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:13.675351 7623 external_mini_cluster.cc:1428] Setting key fc42a3ad6b2c2f3fed9ad5fa3c91db21
I20260806 04:45:13.680948 9443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304: Bootstrap starting.
I20260806 04:45:13.684640 9443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:13.685819 9443 log.cc:824] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:13.689340 9443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304: No bootstrap required, opened a new log
Aug 06 04:45:13 dist-test-slave-0b58 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:13.697886 9443 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd6b3ae1df74366aebd11989041e304" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38139 } }
I20260806 04:45:13.698289 9443 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:13.698426 9443 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cd6b3ae1df74366aebd11989041e304, State: Initialized, Role: FOLLOWER
I20260806 04:45:13.699060 9443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd6b3ae1df74366aebd11989041e304" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38139 } }
I20260806 04:45:13.699383 9443 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:13.699563 9443 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:13.699616 9446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:13.677373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56340 (local address 127.7.113.254:38139)
0806 04:45:13.678184 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:13.678195 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:13.678239 (+ 44us) server_negotiation.cc:407] Connection header received
0806 04:45:13.679899 (+ 1660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:13.679921 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:13.680341 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:13.680675 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:13.682510 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:13.683913 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:13.686278 (+ 2365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:13.687443 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:13.687574 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:13.692386 (+ 4812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:13.692400 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:13.692417 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:13.692452 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:13.695576 (+ 3124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:13.696337 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:13.696344 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:13.696349 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:13.696527 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:13.696916 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:13.696920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:13.696922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:13.697397 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:13.697705 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:13.698129 (+ 424us) server_negotiation.cc:299] Negotiation successful
0806 04:45:13.698535 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":363,"threads_started":1}
I20260806 04:45:13.699772 9443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:13.741400 9443 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd6b3ae1df74366aebd11989041e304" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38139 } }
I20260806 04:45:13.742210 9443 leader_election.cc:302] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3cd6b3ae1df74366aebd11989041e304; no voters:
I20260806 04:45:13.743026 9443 leader_election.cc:288] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:13.743185 9448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:13.745401 9448 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [term 1 LEADER]: Becoming Leader. State: Replica: 3cd6b3ae1df74366aebd11989041e304, State: Running, Role: LEADER
I20260806 04:45:13.746001 9448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd6b3ae1df74366aebd11989041e304" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38139 } }
I20260806 04:45:13.746235 9443 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:13.748817 9450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cd6b3ae1df74366aebd11989041e304. Latest consensus state: current_term: 1 leader_uuid: "3cd6b3ae1df74366aebd11989041e304" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd6b3ae1df74366aebd11989041e304" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38139 } } }
I20260806 04:45:13.749271 9450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:13.748824 9449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3cd6b3ae1df74366aebd11989041e304" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd6b3ae1df74366aebd11989041e304" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38139 } } }
I20260806 04:45:13.749673 9449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:13.751199 9454 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:13.756759 9454 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:13.765918 9454 catalog_manager.cc:1347] Generated new cluster ID: e6c062c3276e41d1b835a44570cc9227
I20260806 04:45:13.766041 9454 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:13.776888 9454 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:13.778420 9454 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:13.786055 9454 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304: Generated new TSK 0
I20260806 04:45:13.786850 9454 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
W20260806 04:45:14.515146 7623 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.7.113.193: real 0.722s user 0.001s sys 0.011s
I20260806 04:45:14.516213 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38139
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:43435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:14.839461 9469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:14.839788 9469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:14.839955 9469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:14.847317 9469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:14.847461 9469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:14.847594 9469 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 04:45:14.847687 9469 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 04:45:14.847816 9469 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:45:14.857852 9469 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:43435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.113.254:38139
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:14.859171 9469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:14.860474 9469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:14.873849 9475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:14.873885 9476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:14.873762 9478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:14.875090 9469 server_base.cc:1034] running on GCE node
I20260806 04:45:14.875655 9469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:14.876600 9469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:14.877856 9469 hybrid_clock.cc:648] HybridClock initialized: now 1785991514877800 us; error 39 us; skew 500 ppm
I20260806 04:45:14.878242 9469 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:14 dist-test-slave-0b58 krb5kdc[9351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991514, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:14.881536 9469 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:45:14.882824 9469 webserver.cc:460] Webserver started at http://127.7.113.193:36863/ using document root <none> and password file <none>
I20260806 04:45:14.883440 9469 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:14.883535 9469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:14.883816 9469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:14.886633 9469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "0f2ee8ab80f644fdad6ee2cf22125cda"
format_stamp: "Formatted at 2026-08-06 04:45:14 on dist-test-slave-0b58"
server_key: "d9358bd01d7c20ded604612e414fb5d1"
server_key_iv: "5cfbd7bfd02e10d418def52f55ca7f80"
server_key_version: "encryptionkey@0"
I20260806 04:45:14.887322 9469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "0f2ee8ab80f644fdad6ee2cf22125cda"
format_stamp: "Formatted at 2026-08-06 04:45:14 on dist-test-slave-0b58"
server_key: "d9358bd01d7c20ded604612e414fb5d1"
server_key_iv: "5cfbd7bfd02e10d418def52f55ca7f80"
server_key_version: "encryptionkey@0"
I20260806 04:45:14.892331 9469 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 04:45:14.895457 9485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:14.896836 9469 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 04:45:14.897010 9469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "0f2ee8ab80f644fdad6ee2cf22125cda"
format_stamp: "Formatted at 2026-08-06 04:45:14 on dist-test-slave-0b58"
server_key: "d9358bd01d7c20ded604612e414fb5d1"
server_key_iv: "5cfbd7bfd02e10d418def52f55ca7f80"
server_key_version: "encryptionkey@0"
I20260806 04:45:14.897213 9469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:14.937675 9469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:14.941426 9469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:14.941723 9469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:14.944229 9469 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:14.944383 9469 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:14.944510 9469 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:14.944607 9469 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 04:45:14 dist-test-slave-0b58 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991514, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:14.969478 9494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:14.944952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:41103 (local address 127.7.113.254:38139)
0806 04:45:14.945431 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:14.945438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:14.946682 (+ 1244us) server_negotiation.cc:407] Connection header received
0806 04:45:14.948941 (+ 2259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:14.948950 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:14.949049 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:14.949177 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:14.951331 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:14.952493 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:14.955746 (+ 3253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:14.956312 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:14.956462 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:14.961833 (+ 5371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:14.961840 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:14.961847 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:14.961898 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:14.965449 (+ 3551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:14.966556 (+ 1107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:14.966560 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:14.966562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:14.966882 (+ 320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:14.967498 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:14.967501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:14.967503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:14.967778 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:14.967887 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:14.969015 (+ 1128us) server_negotiation.cc:299] Negotiation successful
0806 04:45:14.969215 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":241,"threads_started":1}
I20260806 04:45:14.971632 9495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:14.945628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38139 (local address 127.7.113.193:41103)
0806 04:45:14.946511 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:14.946559 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:14.948574 (+ 2015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:14.949429 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:14.949444 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:14.950205 (+ 761us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:14.951069 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:14.951145 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:14.952673 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:14.952682 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:14.955574 (+ 2892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:14.955592 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:14.956596 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:14.956608 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:14.956958 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:14.958088 (+ 1130us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:14.958129 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:14.961489 (+ 3360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:14.965599 (+ 4110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:14.965611 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:14.965630 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:14.966411 (+ 781us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:14.967020 (+ 609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:14.967029 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:14.967035 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:14.967368 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:14.967930 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:14.967941 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:14.968522 (+ 581us) client_negotiation.cc:769] Sending connection context
0806 04:45:14.968926 (+ 404us) client_negotiation.cc:240] Negotiation successful
0806 04:45:14.969614 (+ 688us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":418,"threads_started":1}
I20260806 04:45:14.990649 9469 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:42737
I20260806 04:45:14.990657 9606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:42737 every 8 connection(s)
I20260806 04:45:14.992358 9469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:45:14.994783 9607 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38139
I20260806 04:45:14.995072 9607 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:14.995637 9576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:14.978953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38139 (local address 127.7.113.193:49569)
0806 04:45:14.979617 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:14.979641 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:14.979795 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:14.980391 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:14.980398 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:14.981143 (+ 745us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:14.981696 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:14.981707 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:14.982659 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:14.982665 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:14.984373 (+ 1708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:14.984395 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:14.985834 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:14.985844 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:14.986111 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:14.986937 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:14.986970 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:14.988473 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:14.992651 (+ 4178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:14.992657 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:14.992661 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:14.993340 (+ 679us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:14.993844 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:14.993851 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:14.993854 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:14.993999 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:14.994632 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:14.994637 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:14.994839 (+ 202us) client_negotiation.cc:769] Sending connection context
0806 04:45:14.995002 (+ 163us) client_negotiation.cc:240] Negotiation successful
0806 04:45:14.995322 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":334,"threads_started":1}
I20260806 04:45:14.996012 9607 heartbeater.cc:511] Master 127.7.113.254:38139 requested a full tablet report, sending...
I20260806 04:45:14.996198 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 9469
I20260806 04:45:14.996369 9494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:14.978747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:49569 (local address 127.7.113.254:38139)
0806 04:45:14.978978 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:14.978987 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:14.979739 (+ 752us) server_negotiation.cc:407] Connection header received
0806 04:45:14.980020 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:14.980027 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:14.980115 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:14.980221 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:14.981838 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:14.982513 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:14.984538 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:14.985381 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:14.985562 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:14.988715 (+ 3153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:14.988721 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:14.988725 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:14.988762 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:14.992489 (+ 3727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:14.993510 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:14.993515 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:14.993518 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:14.993698 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:14.994135 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:14.994141 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:14.994145 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:14.994480 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:14.994670 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:14.995165 (+ 495us) server_negotiation.cc:299] Negotiation successful
0806 04:45:14.995409 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 04:45:14.996456 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:45:14.997249 7623 external_mini_cluster.cc:1428] Setting key f31fa1fa37560af4fc2e4b046b659ffb
I20260806 04:45:14.998711 9397 ts_manager.cc:194] Registered new tserver with Master: 0f2ee8ab80f644fdad6ee2cf22125cda (127.7.113.193:42737)
I20260806 04:45:15.000299 9397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:41103
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:45:15.043022 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38139
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:43435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:15.363217 9611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:15.363497 9611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:15.363600 9611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:15.370857 9611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:15.370951 9611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:15.371032 9611 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 04:45:15.371085 9611 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 04:45:15.371156 9611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:45:15.380630 9611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:43435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.113.254:38139
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:15.381775 9611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:15.383001 9611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:15.395869 9617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:15.395916 9620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:15.395967 9618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:15.401670 9611 server_base.cc:1034] running on GCE node
I20260806 04:45:15.402357 9611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:15.403241 9611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:15.404428 9611 hybrid_clock.cc:648] HybridClock initialized: now 1785991515404390 us; error 31 us; skew 500 ppm
I20260806 04:45:15.404735 9611 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:15 dist-test-slave-0b58 krb5kdc[9351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991515, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:15.407735 9611 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:45:15.409191 9611 webserver.cc:460] Webserver started at http://127.7.113.194:44743/ using document root <none> and password file <none>
I20260806 04:45:15.409880 9611 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:15.409984 9611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:15.410243 9611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:15.413034 9611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "1308f5e062c243938cab9785bfb6c985"
format_stamp: "Formatted at 2026-08-06 04:45:15 on dist-test-slave-0b58"
server_key: "14209213f51e7a474f1afc25311da4f5"
server_key_iv: "e509a56b3b7586d363c50f84ce10dcb7"
server_key_version: "encryptionkey@0"
I20260806 04:45:15.413722 9611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "1308f5e062c243938cab9785bfb6c985"
format_stamp: "Formatted at 2026-08-06 04:45:15 on dist-test-slave-0b58"
server_key: "14209213f51e7a474f1afc25311da4f5"
server_key_iv: "e509a56b3b7586d363c50f84ce10dcb7"
server_key_version: "encryptionkey@0"
I20260806 04:45:15.418627 9611 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 04:45:15.421892 9627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:15.423126 9611 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 04:45:15.423306 9611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "1308f5e062c243938cab9785bfb6c985"
format_stamp: "Formatted at 2026-08-06 04:45:15 on dist-test-slave-0b58"
server_key: "14209213f51e7a474f1afc25311da4f5"
server_key_iv: "e509a56b3b7586d363c50f84ce10dcb7"
server_key_version: "encryptionkey@0"
I20260806 04:45:15.423496 9611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:15.479800 9611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:15.483871 9611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:15.484166 9611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:15.486837 9611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:15.486969 9611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:15.487080 9611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:15.487167 9611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 04:45:15 dist-test-slave-0b58 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991515, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:15.510344 9494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:15.487542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:46345 (local address 127.7.113.254:38139)
0806 04:45:15.487722 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:15.487727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:15.489314 (+ 1587us) server_negotiation.cc:407] Connection header received
0806 04:45:15.491296 (+ 1982us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:15.491303 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:15.491400 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:15.491512 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:15.493364 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:15.494740 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:15.497410 (+ 2670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:15.498045 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:15.498181 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:15.502996 (+ 4815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:15.503002 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:15.503005 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:15.503064 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:15.506642 (+ 3578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:15.507611 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:15.507614 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:15.507617 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:15.507724 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:15.508392 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:15.508397 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:15.508400 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:15.508662 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:15.508816 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:15.509752 (+ 936us) server_negotiation.cc:299] Negotiation successful
0806 04:45:15.509964 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 04:45:15.511307 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:15.488331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38139 (local address 127.7.113.194:46345)
0806 04:45:15.489141 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:15.489180 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:15.491013 (+ 1833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:15.491753 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:15.491764 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:15.492233 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:15.493122 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:15.493141 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:15.494934 (+ 1793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:15.494943 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:15.497171 (+ 2228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:15.497194 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:15.498328 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:15.498342 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:15.498578 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:15.499250 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:15.499289 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:15.502740 (+ 3451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:15.506784 (+ 4044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:15.506793 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:15.506809 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:15.507411 (+ 602us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:15.507889 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:15.507895 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:15.507902 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:15.508213 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:15.508802 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:15.508809 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:15.509299 (+ 490us) client_negotiation.cc:769] Sending connection context
0806 04:45:15.509672 (+ 373us) client_negotiation.cc:240] Negotiation successful
0806 04:45:15.510170 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":325,"threads_started":1}
I20260806 04:45:15.535205 9494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:15.520072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:60427 (local address 127.7.113.254:38139)
0806 04:45:15.520239 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:15.520243 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:15.521023 (+ 780us) server_negotiation.cc:407] Connection header received
0806 04:45:15.521150 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:15.521158 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:15.521258 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:15.521408 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:15.522329 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:15.523789 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:15.525639 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:15.526413 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:15.526552 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:15.528839 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:15.528849 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:15.528856 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:15.528904 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:15.532164 (+ 3260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:15.533186 (+ 1022us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:15.533193 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:15.533199 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:15.533357 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:15.533823 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:15.533826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:15.533828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:15.534124 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:15.534244 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:15.534830 (+ 586us) server_negotiation.cc:299] Negotiation successful
0806 04:45:15.534985 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 04:45:15.535778 9717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:15.520196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38139 (local address 127.7.113.194:60427)
0806 04:45:15.520930 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:15.520949 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:15.521055 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:15.521489 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:15.521494 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:15.521901 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:15.522183 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:15.522192 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:15.523932 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:15.523936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:15.525476 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:15.525497 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:15.526584 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:15.526588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:15.526789 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:15.527394 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:15.527410 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:15.528628 (+ 1218us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:15.532307 (+ 3679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:15.532315 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:15.532322 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:15.533033 (+ 711us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:15.533475 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:15.533483 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:15.533489 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:15.533689 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:15.534244 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:15.534249 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:15.534505 (+ 256us) client_negotiation.cc:769] Sending connection context
0806 04:45:15.534683 (+ 178us) client_negotiation.cc:240] Negotiation successful
0806 04:45:15.535103 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":468,"threads_started":1}
I20260806 04:45:15.542071 9611 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:44461
I20260806 04:45:15.542100 9747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:44461 every 8 connection(s)
I20260806 04:45:15.543226 9611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:45:15.545161 9748 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38139
I20260806 04:45:15.545389 9748 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:15.546000 9748 heartbeater.cc:511] Master 127.7.113.254:38139 requested a full tablet report, sending...
I20260806 04:45:15.547278 9397 ts_manager.cc:194] Registered new tserver with Master: 1308f5e062c243938cab9785bfb6c985 (127.7.113.194:44461)
I20260806 04:45:15.548218 9397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:46345
I20260806 04:45:15.552150 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 9611
I20260806 04:45:15.552393 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:45:15.552898 7623 external_mini_cluster.cc:1428] Setting key 3e0ab839df34506d6530d60f1b378edf
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:45:15.595959 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38139
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:43435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:15.919528 9752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:15.919818 9752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:15.919924 9752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:15.927021 9752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:15.927165 9752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:15.927322 9752 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 04:45:15.927407 9752 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 04:45:15.927528 9752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:45:15.937166 9752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:43435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.113.254:38139
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:15.938347 9752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:15.939605 9752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:15.952754 9761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:15.952728 9759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:15.953248 9758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:15.953922 9752 server_base.cc:1034] running on GCE node
I20260806 04:45:15.954555 9752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:15.955425 9752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:15.956663 9752 hybrid_clock.cc:648] HybridClock initialized: now 1785991515956604 us; error 51 us; skew 500 ppm
I20260806 04:45:15.956974 9752 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:15 dist-test-slave-0b58 krb5kdc[9351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991515, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:15.959904 9752 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:45:15.961356 9752 webserver.cc:460] Webserver started at http://127.7.113.195:46773/ using document root <none> and password file <none>
I20260806 04:45:15.962044 9752 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:15.962191 9752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:15.962503 9752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:15.965648 9752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "3584aa3de2e4435aab253c167083d071"
format_stamp: "Formatted at 2026-08-06 04:45:15 on dist-test-slave-0b58"
server_key: "ac93657a0232787b6362b70c95c08134"
server_key_iv: "b41b326e53f06ea9028f05a5e7a6ddbc"
server_key_version: "encryptionkey@0"
I20260806 04:45:15.966425 9752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "3584aa3de2e4435aab253c167083d071"
format_stamp: "Formatted at 2026-08-06 04:45:15 on dist-test-slave-0b58"
server_key: "ac93657a0232787b6362b70c95c08134"
server_key_iv: "b41b326e53f06ea9028f05a5e7a6ddbc"
server_key_version: "encryptionkey@0"
I20260806 04:45:15.971325 9752 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 04:45:15.974704 9768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:15.975915 9752 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:45:15.976202 9752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "3584aa3de2e4435aab253c167083d071"
format_stamp: "Formatted at 2026-08-06 04:45:15 on dist-test-slave-0b58"
server_key: "ac93657a0232787b6362b70c95c08134"
server_key_iv: "b41b326e53f06ea9028f05a5e7a6ddbc"
server_key_version: "encryptionkey@0"
I20260806 04:45:15.976476 9752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:15.996784 9752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:16.000849 9752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:16.001196 9752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:16.003916 9607 heartbeater.cc:503] Master 127.7.113.254:38139 was elected leader, sending a full tablet report...
I20260806 04:45:16.003925 9752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:16.004070 9752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:16.004202 9752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:16.004307 9752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 04:45:16 dist-test-slave-0b58 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991515, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:16.025719 9494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.004589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:42917 (local address 127.7.113.254:38139)
0806 04:45:16.005010 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.005014 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.006260 (+ 1246us) server_negotiation.cc:407] Connection header received
0806 04:45:16.008226 (+ 1966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.008231 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.008346 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.008466 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:16.010633 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.011774 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.014243 (+ 2469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.014737 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.014871 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.019088 (+ 4217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:16.019097 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:16.019104 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:16.019146 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:16.022273 (+ 3127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:16.022977 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:16.022983 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:16.022986 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:16.023130 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:16.023569 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:16.023575 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:16.023578 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:16.023939 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:16.024096 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.025155 (+ 1059us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.025373 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309}
I20260806 04:45:16.026839 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.005119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38139 (local address 127.7.113.195:42917)
0806 04:45:16.006069 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.006131 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.007962 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.008692 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.008699 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.009431 (+ 732us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:16.010369 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.010405 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.011942 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.011954 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.014103 (+ 2149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.014116 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.014980 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.014989 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.015198 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.015873 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:16.015898 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:16.018755 (+ 2857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:16.022425 (+ 3670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:16.022433 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:16.022447 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:16.022851 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:16.023243 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:16.023248 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:16.023252 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:16.023444 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:16.024177 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:16.024183 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:16.024731 (+ 548us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.025048 (+ 317us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.025526 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":405,"threads_started":1}
I20260806 04:45:16.049026 9827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.033078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38139 (local address 127.7.113.195:49407)
0806 04:45:16.033705 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.033723 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.033840 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.034202 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.034205 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.034580 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:16.034869 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.034877 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.036654 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.036661 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.038215 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.038247 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.039438 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.039442 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.039745 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.040554 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:16.040571 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:16.041989 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:16.045394 (+ 3405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:16.045399 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:16.045403 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:16.046151 (+ 748us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:16.046556 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:16.046563 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:16.046568 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:16.046781 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:16.047565 (+ 784us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:16.047573 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:16.047891 (+ 318us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.048062 (+ 171us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.048537 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":330,"threads_started":1}
I20260806 04:45:16.050014 9494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.032945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:49407 (local address 127.7.113.254:38139)
0806 04:45:16.033155 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.033164 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.033812 (+ 648us) server_negotiation.cc:407] Connection header received
0806 04:45:16.033940 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.033948 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.034060 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.034193 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:16.035007 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.036480 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.038440 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.039062 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.039174 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.042177 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:16.042184 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:16.042188 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:16.042228 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:16.045237 (+ 3009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:16.046280 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:16.046288 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:16.046291 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:16.046440 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:16.046915 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:16.046920 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:16.046924 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:16.047294 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:16.047482 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.049502 (+ 2020us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.049758 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 04:45:16.064947 9752 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:46547
I20260806 04:45:16.064990 9887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:46547 every 8 connection(s)
I20260806 04:45:16.066372 9752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:45:16.068745 9888 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38139
I20260806 04:45:16.068951 9888 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:16.069600 9888 heartbeater.cc:511] Master 127.7.113.254:38139 requested a full tablet report, sending...
I20260806 04:45:16.070868 9397 ts_manager.cc:194] Registered new tserver with Master: 3584aa3de2e4435aab253c167083d071 (127.7.113.195:46547)
I20260806 04:45:16.071607 9397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:42917
I20260806 04:45:16.074405 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 9752
I20260806 04:45:16.074609 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:45:16.075138 7623 external_mini_cluster.cc:1428] Setting key 86b94f502818525149489d26bfeaab1e
I20260806 04:45:16.077919 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 04:45:16 dist-test-slave-0b58 krb5kdc[9351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991516, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 04:45:16 dist-test-slave-0b58 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991516, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:16.129473 9494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.115505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56344 (local address 127.7.113.254:38139)
0806 04:45:16.115756 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.115763 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.115967 (+ 204us) server_negotiation.cc:407] Connection header received
0806 04:45:16.116199 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.116203 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.116312 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.116420 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:16.117875 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.118601 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.119845 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.120400 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.120534 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.124296 (+ 3762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:16.124303 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:16.124313 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:16.124348 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:16.126777 (+ 2429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:16.127416 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:16.127423 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:16.127428 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:16.127556 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:16.127963 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:16.127969 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:16.127972 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:16.128241 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:16.128528 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.128859 (+ 331us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.129106 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 04:45:16.133455 9397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56344:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:45:16.140192 9397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:45:16.171850 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.153029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55526 (local address 127.7.113.195:46547)
0806 04:45:16.153994 (+ 965us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.154006 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.161031 (+ 7025us) server_negotiation.cc:407] Connection header received
0806 04:45:16.161516 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.161527 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.161811 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.162019 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:16.164457 (+ 2438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.165930 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.169006 (+ 3076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.170333 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.170457 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.170700 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.171303 (+ 603us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.171470 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724,"thread_start_us":505,"threads_started":1}
I20260806 04:45:16.171888 9903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.152109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:46547 (local address 127.0.0.1:55526)
0806 04:45:16.160838 (+ 8729us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.160901 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.161225 (+ 324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.162532 (+ 1307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.162543 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.162594 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:16.163095 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.163112 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.166125 (+ 3013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.166130 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.168798 (+ 2668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.168814 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.170833 (+ 2019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.170839 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.171027 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.171077 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.171204 (+ 127us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.171417 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8380,"mutex_wait_us":2,"thread_start_us":9131,"threads_started":1}
I20260806 04:45:16.172580 9902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.152461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:44461 (local address 127.0.0.1:52746)
0806 04:45:16.164674 (+ 12213us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.164694 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.164816 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.165360 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.165365 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.165392 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:16.165809 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.165826 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.167328 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.167334 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.169763 (+ 2429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.169779 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.171751 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.171757 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.171959 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.171997 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.172089 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.172233 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8957,"thread_start_us":7864,"threads_started":1}
I20260806 04:45:16.172850 9904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.152520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52746 (local address 127.7.113.194:44461)
0806 04:45:16.163583 (+ 11063us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.163595 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.164825 (+ 1230us) server_negotiation.cc:407] Connection header received
0806 04:45:16.164946 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.164956 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.165178 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.165363 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:16.166002 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.167183 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.169936 (+ 2753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.171272 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.171398 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.171591 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.172385 (+ 794us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.172547 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10818,"thread_start_us":11076,"threads_started":1}
I20260806 04:45:16.172956 9906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.161639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:42737 (local address 127.0.0.1:44362)
0806 04:45:16.164331 (+ 2692us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.164354 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.164502 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.165921 (+ 1419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.165925 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.165951 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:16.166492 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.166505 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.168034 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.168039 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.170260 (+ 2221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.170271 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.171663 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.171673 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.171868 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.171913 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.171987 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.172122 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2518,"mutex_wait_us":73,"thread_start_us":2330,"threads_started":1}
I20260806 04:45:16.173079 9907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.162002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44362 (local address 127.7.113.193:42737)
0806 04:45:16.165353 (+ 3351us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.165360 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.165384 (+ 24us) server_negotiation.cc:407] Connection header received
0806 04:45:16.165477 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.165487 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.165707 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.165910 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:16.166706 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.167885 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.170401 (+ 2516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.171420 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.172385 (+ 965us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.172599 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.172665 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.172807 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3169,"thread_start_us":3033,"threads_started":1}
I20260806 04:45:16.176231 9678 tablet_service.cc:1467] Processing CreateTablet for tablet 7edd24b00e854a4fa1d453ab17937017 (DEFAULT_TABLE table=test-table [id=a95c5b3be94d439a803175bf49a60302]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:16.176241 9818 tablet_service.cc:1467] Processing CreateTablet for tablet 7edd24b00e854a4fa1d453ab17937017 (DEFAULT_TABLE table=test-table [id=a95c5b3be94d439a803175bf49a60302]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:16.176568 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 7edd24b00e854a4fa1d453ab17937017 (DEFAULT_TABLE table=test-table [id=a95c5b3be94d439a803175bf49a60302]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:16.177517 9678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7edd24b00e854a4fa1d453ab17937017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:16.177738 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7edd24b00e854a4fa1d453ab17937017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:16.177755 9818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7edd24b00e854a4fa1d453ab17937017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:16.188766 9908 tablet_bootstrap.cc:492] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985: Bootstrap starting.
I20260806 04:45:16.191946 9909 tablet_bootstrap.cc:492] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda: Bootstrap starting.
I20260806 04:45:16.192787 9908 tablet_bootstrap.cc:654] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:16.192788 9910 tablet_bootstrap.cc:492] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071: Bootstrap starting.
I20260806 04:45:16.194166 9908 log.cc:824] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:16.195813 9909 tablet_bootstrap.cc:654] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:16.196501 9910 tablet_bootstrap.cc:654] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:16.197122 9909 log.cc:824] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:16.197751 9910 log.cc:824] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:16.199156 9908 tablet_bootstrap.cc:492] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985: No bootstrap required, opened a new log
I20260806 04:45:16.199465 9908 ts_tablet_manager.cc:1397] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20260806 04:45:16.200125 9909 tablet_bootstrap.cc:492] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda: No bootstrap required, opened a new log
I20260806 04:45:16.200433 9909 ts_tablet_manager.cc:1397] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 04:45:16.201545 9910 tablet_bootstrap.cc:492] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071: No bootstrap required, opened a new log
I20260806 04:45:16.201820 9910 ts_tablet_manager.cc:1397] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260806 04:45:16.209084 9910 raft_consensus.cc:348] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } }
I20260806 04:45:16.209430 9910 raft_consensus.cc:374] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:16.209555 9910 raft_consensus.cc:729] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3584aa3de2e4435aab253c167083d071, State: Initialized, Role: FOLLOWER
I20260806 04:45:16.210219 9910 consensus_queue.cc:260] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } }
I20260806 04:45:16.210438 9908 raft_consensus.cc:348] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } }
I20260806 04:45:16.210899 9908 raft_consensus.cc:374] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:16.211025 9908 raft_consensus.cc:729] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1308f5e062c243938cab9785bfb6c985, State: Initialized, Role: FOLLOWER
I20260806 04:45:16.210846 9909 raft_consensus.cc:348] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } }
I20260806 04:45:16.211334 9909 raft_consensus.cc:374] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:16.211400 9888 heartbeater.cc:503] Master 127.7.113.254:38139 was elected leader, sending a full tablet report...
I20260806 04:45:16.211491 9909 raft_consensus.cc:729] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f2ee8ab80f644fdad6ee2cf22125cda, State: Initialized, Role: FOLLOWER
I20260806 04:45:16.211702 9908 consensus_queue.cc:260] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } }
I20260806 04:45:16.212033 9910 ts_tablet_manager.cc:1428] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071: Time spent starting tablet: real 0.010s user 0.006s sys 0.004s
I20260806 04:45:16.212209 9909 consensus_queue.cc:260] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } }
I20260806 04:45:16.216531 9909 ts_tablet_manager.cc:1428] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260806 04:45:16.217494 9748 heartbeater.cc:503] Master 127.7.113.254:38139 was elected leader, sending a full tablet report...
I20260806 04:45:16.218009 9908 ts_tablet_manager.cc:1428] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985: Time spent starting tablet: real 0.018s user 0.017s sys 0.000s
W20260806 04:45:16.244921 9608 tablet.cc:2369] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:45:16.253444 9914 raft_consensus.cc:482] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:16.253782 9914 raft_consensus.cc:504] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } }
I20260806 04:45:16.255724 9914 leader_election.cc:288] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1308f5e062c243938cab9785bfb6c985 (127.7.113.194:44461), 0f2ee8ab80f644fdad6ee2cf22125cda (127.7.113.193:42737)
I20260806 04:45:16.261863 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.255880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:44461 (local address 127.7.113.195:41153)
0806 04:45:16.256290 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.256315 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.256467 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.256871 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.256877 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.256909 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:16.257129 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.257144 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.258364 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.258370 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.259927 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.259939 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.261104 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.261112 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.261322 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.261364 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.261461 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.261570 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":62}
I20260806 04:45:16.261895 9904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.255969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:41153 (local address 127.7.113.194:44461)
0806 04:45:16.256166 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.256172 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.256533 (+ 361us) server_negotiation.cc:407] Connection header received
0806 04:45:16.256623 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.256628 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.256711 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.256821 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:16.257279 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.258218 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.260090 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.260954 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.261077 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.261128 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.261503 (+ 375us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.261636 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 04:45:16.262136 9907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.256208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:51021 (local address 127.7.113.193:42737)
0806 04:45:16.256467 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.256473 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.256839 (+ 366us) server_negotiation.cc:407] Connection header received
0806 04:45:16.257004 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.257009 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.257100 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.257201 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:16.257793 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.258588 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.260369 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.261191 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.261368 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.261449 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.261742 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.261872 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260806 04:45:16.262172 9917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.256000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:42737 (local address 127.7.113.195:51021)
0806 04:45:16.256716 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.256732 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.256867 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.257238 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.257245 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.257270 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:16.257646 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.257658 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.258734 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.258738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.260188 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.260202 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.261392 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.261397 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.261570 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.261601 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.261694 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.261829 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":348,"threads_started":1}
I20260806 04:45:16.263080 9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7edd24b00e854a4fa1d453ab17937017" candidate_uuid: "3584aa3de2e4435aab253c167083d071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1308f5e062c243938cab9785bfb6c985" is_pre_election: true
I20260806 04:45:16.263082 9557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7edd24b00e854a4fa1d453ab17937017" candidate_uuid: "3584aa3de2e4435aab253c167083d071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" is_pre_election: true
I20260806 04:45:16.263566 9557 raft_consensus.cc:2454] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3584aa3de2e4435aab253c167083d071 in term 0.
I20260806 04:45:16.263567 9698 raft_consensus.cc:2454] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3584aa3de2e4435aab253c167083d071 in term 0.
I20260806 04:45:16.264218 9770 leader_election.cc:302] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0f2ee8ab80f644fdad6ee2cf22125cda, 1308f5e062c243938cab9785bfb6c985, 3584aa3de2e4435aab253c167083d071; no voters:
I20260806 04:45:16.264674 9914 raft_consensus.cc:2781] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:45:16.264837 9914 raft_consensus.cc:482] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:45:16.264956 9914 raft_consensus.cc:3037] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:16.267114 9914 raft_consensus.cc:504] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } }
I20260806 04:45:16.267683 9914 leader_election.cc:288] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [CANDIDATE]: Term 1 election: Requested vote from peers 1308f5e062c243938cab9785bfb6c985 (127.7.113.194:44461), 0f2ee8ab80f644fdad6ee2cf22125cda (127.7.113.193:42737)
I20260806 04:45:16.268050 9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7edd24b00e854a4fa1d453ab17937017" candidate_uuid: "3584aa3de2e4435aab253c167083d071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1308f5e062c243938cab9785bfb6c985"
I20260806 04:45:16.268216 9557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7edd24b00e854a4fa1d453ab17937017" candidate_uuid: "3584aa3de2e4435aab253c167083d071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda"
I20260806 04:45:16.268281 9698 raft_consensus.cc:3037] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:16.268456 9557 raft_consensus.cc:3037] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:16.270648 9557 raft_consensus.cc:2454] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3584aa3de2e4435aab253c167083d071 in term 1.
I20260806 04:45:16.270756 9698 raft_consensus.cc:2454] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3584aa3de2e4435aab253c167083d071 in term 1.
I20260806 04:45:16.271044 9769 leader_election.cc:302] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f2ee8ab80f644fdad6ee2cf22125cda, 3584aa3de2e4435aab253c167083d071; no voters:
I20260806 04:45:16.271348 9914 raft_consensus.cc:2781] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:16.271783 9914 raft_consensus.cc:686] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [term 1 LEADER]: Becoming Leader. State: Replica: 3584aa3de2e4435aab253c167083d071, State: Running, Role: LEADER
I20260806 04:45:16.272305 9914 consensus_queue.cc:237] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } }
I20260806 04:45:16.276985 9396 catalog_manager.cc:5495] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3584aa3de2e4435aab253c167083d071 (127.7.113.195). New cstate: current_term: 1 leader_uuid: "3584aa3de2e4435aab253c167083d071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } health_report { overall_health: UNKNOWN } } }
W20260806 04:45:16.295153 9749 tablet.cc:2369] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:45:16.318121 9889 tablet.cc:2369] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 04:45:16 dist-test-slave-0b58 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991513, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:16.343281 9925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.330642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38139 (local address 127.0.0.1:56348)
0806 04:45:16.331254 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.331270 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.331385 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.331681 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.331685 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.332390 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:16.332649 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.332658 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.333635 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.333639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.334572 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.334581 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.335288 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.335292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.335405 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.336101 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:16.336117 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:16.338235 (+ 2118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:16.341156 (+ 2921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:16.341166 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:16.341171 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:16.341558 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:16.341863 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:16.341866 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:16.341868 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:16.341995 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:16.342466 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:16.342471 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:16.342602 (+ 131us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.342732 (+ 130us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.342925 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":314,"threads_started":1}
I20260806 04:45:16.343297 9494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.330553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56348 (local address 127.7.113.254:38139)
0806 04:45:16.330717 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.330722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.331349 (+ 627us) server_negotiation.cc:407] Connection header received
0806 04:45:16.331480 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.331484 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.331564 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.331643 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:16.332771 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.333524 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.334711 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.335123 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.335223 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.338444 (+ 3221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:16.338449 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:16.338453 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:16.338484 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:16.341033 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:16.341656 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:16.341660 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:16.341663 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:16.341772 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:16.342084 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:16.342087 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:16.342089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:16.342361 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:16.342467 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.342821 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.343051 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":59}
I20260806 04:45:16.347944 9396 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:56348:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 04:45:16.349010 9396 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:45:16.355928 9537 tablet_service.cc:1467] Processing CreateTablet for tablet 89133749449947ec9f4704087e505a3a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=844d07822ecc41da8aa3e241de28a996]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 04:45:16.356081 9678 tablet_service.cc:1467] Processing CreateTablet for tablet 89133749449947ec9f4704087e505a3a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=844d07822ecc41da8aa3e241de28a996]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 04:45:16.356941 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89133749449947ec9f4704087e505a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:16.356506 9818 tablet_service.cc:1467] Processing CreateTablet for tablet 89133749449947ec9f4704087e505a3a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=844d07822ecc41da8aa3e241de28a996]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 04:45:16.357028 9678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89133749449947ec9f4704087e505a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:16.357276 9818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89133749449947ec9f4704087e505a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:16.363318 9909 tablet_bootstrap.cc:492] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda: Bootstrap starting.
I20260806 04:45:16.364219 9910 tablet_bootstrap.cc:492] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071: Bootstrap starting.
I20260806 04:45:16.364966 9908 tablet_bootstrap.cc:492] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985: Bootstrap starting.
I20260806 04:45:16.365087 9909 tablet_bootstrap.cc:654] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:16.366057 9910 tablet_bootstrap.cc:654] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:16.366411 9908 tablet_bootstrap.cc:654] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:16.367833 9909 tablet_bootstrap.cc:492] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda: No bootstrap required, opened a new log
I20260806 04:45:16.368005 9909 ts_tablet_manager.cc:1397] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 04:45:16.368732 9910 tablet_bootstrap.cc:492] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071: No bootstrap required, opened a new log
I20260806 04:45:16.368861 9908 tablet_bootstrap.cc:492] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985: No bootstrap required, opened a new log
I20260806 04:45:16.368888 9910 ts_tablet_manager.cc:1397] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 04:45:16.369036 9908 ts_tablet_manager.cc:1397] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260806 04:45:16.368932 9909 raft_consensus.cc:348] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.369201 9909 raft_consensus.cc:374] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:16.369323 9909 raft_consensus.cc:729] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f2ee8ab80f644fdad6ee2cf22125cda, State: Initialized, Role: FOLLOWER
I20260806 04:45:16.369586 9909 consensus_queue.cc:260] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.369786 9910 raft_consensus.cc:348] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.370054 9910 raft_consensus.cc:374] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:16.369912 9908 raft_consensus.cc:348] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.370153 9910 raft_consensus.cc:729] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3584aa3de2e4435aab253c167083d071, State: Initialized, Role: FOLLOWER
I20260806 04:45:16.370188 9908 raft_consensus.cc:374] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:16.370292 9908 raft_consensus.cc:729] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1308f5e062c243938cab9785bfb6c985, State: Initialized, Role: FOLLOWER
I20260806 04:45:16.370141 9916 tablet_replica.cc:439] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } }
I20260806 04:45:16.370523 9916 tablet_replica.cc:442] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:45:16.370415 9910 consensus_queue.cc:260] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.370525 9908 consensus_queue.cc:260] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.370826 9914 tablet_replica.cc:439] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } }
I20260806 04:45:16.371076 9914 tablet_replica.cc:442] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:45:16.371548 9910 ts_tablet_manager.cc:1428] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260806 04:45:16.371558 9909 ts_tablet_manager.cc:1428] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 04:45:16.371109 9908 ts_tablet_manager.cc:1428] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 04:45:16.371958 9915 tablet_replica.cc:439] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } }
I20260806 04:45:16.372411 9915 tablet_replica.cc:442] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:45:16.545818 9916 raft_consensus.cc:482] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:16.546150 9916 raft_consensus.cc:504] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.547905 9916 leader_election.cc:288] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1308f5e062c243938cab9785bfb6c985 (127.7.113.194:44461), 3584aa3de2e4435aab253c167083d071 (127.7.113.195:46547)
I20260806 04:45:16.556380 9929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.548046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:44461 (local address 127.7.113.193:50993)
0806 04:45:16.549283 (+ 1237us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.549310 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.549634 (+ 324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.550146 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.550149 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.550200 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:16.550648 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.550659 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.552402 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.552406 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.553912 (+ 1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.553924 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.555560 (+ 1636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.555566 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.555740 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.555774 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.555869 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.555994 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1028,"thread_start_us":827,"threads_started":1}
I20260806 04:45:16.556421 9904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.548569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:50993 (local address 127.7.113.194:44461)
0806 04:45:16.548743 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.548749 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.549491 (+ 742us) server_negotiation.cc:407] Connection header received
0806 04:45:16.549812 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.549817 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.549882 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.549959 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:16.550905 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.552209 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.554080 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.555333 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.555500 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.555579 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.555949 (+ 370us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.556095 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 04:45:16.557153 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.548409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:32821 (local address 127.7.113.195:46547)
0806 04:45:16.548635 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.548645 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.549950 (+ 1305us) server_negotiation.cc:407] Connection header received
0806 04:45:16.550249 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.550257 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.550343 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.550447 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:16.551098 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.552179 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.554656 (+ 2477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.556005 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.556149 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.556222 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.556853 (+ 631us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.556974 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 04:45:16.557394 9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89133749449947ec9f4704087e505a3a" candidate_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1308f5e062c243938cab9785bfb6c985" is_pre_election: true
I20260806 04:45:16.557657 9698 raft_consensus.cc:2454] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f2ee8ab80f644fdad6ee2cf22125cda in term 0.
I20260806 04:45:16.557888 9930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.548300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:46547 (local address 127.7.113.193:32821)
0806 04:45:16.549827 (+ 1527us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.549849 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.550099 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.550492 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.550497 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.550521 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:16.550915 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.550925 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.552366 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.552371 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.554520 (+ 2149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.554535 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.556434 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.556443 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.556628 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.556676 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.557347 (+ 671us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.557478 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1396,"mutex_wait_us":1,"thread_start_us":1199,"threads_started":1}
I20260806 04:45:16.558197 9487 leader_election.cc:302] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f2ee8ab80f644fdad6ee2cf22125cda, 1308f5e062c243938cab9785bfb6c985; no voters:
I20260806 04:45:16.558642 9916 raft_consensus.cc:2781] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:45:16.558789 9916 raft_consensus.cc:482] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:45:16.558918 9916 raft_consensus.cc:3037] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:16.558828 9843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89133749449947ec9f4704087e505a3a" candidate_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3584aa3de2e4435aab253c167083d071" is_pre_election: true
I20260806 04:45:16.559183 9843 raft_consensus.cc:2454] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f2ee8ab80f644fdad6ee2cf22125cda in term 0.
I20260806 04:45:16.561375 9916 raft_consensus.cc:504] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.561905 9916 leader_election.cc:288] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [CANDIDATE]: Term 1 election: Requested vote from peers 1308f5e062c243938cab9785bfb6c985 (127.7.113.194:44461), 3584aa3de2e4435aab253c167083d071 (127.7.113.195:46547)
I20260806 04:45:16.562274 9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89133749449947ec9f4704087e505a3a" candidate_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1308f5e062c243938cab9785bfb6c985"
I20260806 04:45:16.562345 9843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89133749449947ec9f4704087e505a3a" candidate_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3584aa3de2e4435aab253c167083d071"
I20260806 04:45:16.562500 9698 raft_consensus.cc:3037] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:16.562521 9843 raft_consensus.cc:3037] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:16.565433 9698 raft_consensus.cc:2454] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f2ee8ab80f644fdad6ee2cf22125cda in term 1.
I20260806 04:45:16.565448 9843 raft_consensus.cc:2454] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f2ee8ab80f644fdad6ee2cf22125cda in term 1.
I20260806 04:45:16.565843 9487 leader_election.cc:302] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f2ee8ab80f644fdad6ee2cf22125cda, 1308f5e062c243938cab9785bfb6c985; no voters:
I20260806 04:45:16.566124 9916 raft_consensus.cc:2781] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:16.566565 9916 raft_consensus.cc:686] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 LEADER]: Becoming Leader. State: Replica: 0f2ee8ab80f644fdad6ee2cf22125cda, State: Running, Role: LEADER
I20260806 04:45:16.567051 9916 consensus_queue.cc:237] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.569868 9931 tablet_replica.cc:439] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda: TxnStatusTablet state changed. Reason: New leader 0f2ee8ab80f644fdad6ee2cf22125cda. Latest consensus state: current_term: 1 leader_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } }
I20260806 04:45:16.570216 9931 tablet_replica.cc:442] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda: This TxnStatusTablet replica's current role is: LEADER
I20260806 04:45:16.570991 9933 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 04:45:16.571259 9933 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 04:45:16.571770 9397 catalog_manager.cc:5495] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f2ee8ab80f644fdad6ee2cf22125cda (127.7.113.193). New cstate: current_term: 1 leader_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } health_report { overall_health: UNKNOWN } } }
I20260806 04:45:16.606539 9925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.600797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:42737 (local address 127.0.0.1:44370)
0806 04:45:16.601061 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.601082 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.601244 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.601738 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.601742 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.601753 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 04:45:16.602003 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.602030 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.603115 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.603121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.604119 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.604131 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.604890 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.604896 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.605071 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.605137 (+ 66us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 04:45:16.605983 (+ 846us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 04:45:16.606005 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.606083 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.606245 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 04:45:16.606582 9907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.600698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44370 (local address 127.7.113.193:42737)
0806 04:45:16.600894 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.600901 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.601139 (+ 238us) server_negotiation.cc:407] Connection header received
0806 04:45:16.601479 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.601483 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.601575 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.601716 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:16.602159 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.602983 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.604306 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.604723 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.604860 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.605338 (+ 478us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:16.605840 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:16.606015 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.606116 (+ 101us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.606214 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 04:45:16.614606 9843 raft_consensus.cc:1261] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Refusing update from remote peer 0f2ee8ab80f644fdad6ee2cf22125cda: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:16.614667 9698 raft_consensus.cc:1261] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Refusing update from remote peer 0f2ee8ab80f644fdad6ee2cf22125cda: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:16.615612 9931 consensus_queue.cc:1035] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [LEADER]: Connected to new peer: Peer: permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:16.615962 9916 consensus_queue.cc:1035] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda [LEADER]: Connected to new peer: Peer: permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:16.622459 9914 tablet_replica.cc:439] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071: TxnStatusTablet state changed. Reason: New leader 0f2ee8ab80f644fdad6ee2cf22125cda. Latest consensus state: current_term: 1 leader_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } }
I20260806 04:45:16.622761 9914 tablet_replica.cc:442] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:45:16.627040 9936 mvcc.cc:205] Tried to move back new op lower bound from 7315421252043325440 to 7315421251861958656. Current Snapshot: MvccSnapshot[applied={T|T < 7315421252043325440}]
I20260806 04:45:16.628204 9915 tablet_replica.cc:439] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985: TxnStatusTablet state changed. Reason: New leader 0f2ee8ab80f644fdad6ee2cf22125cda. Latest consensus state: current_term: 1 leader_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } }
I20260806 04:45:16.628500 9915 tablet_replica.cc:442] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:45:16.644500 9914 tablet_replica.cc:439] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } }
I20260806 04:45:16.644884 9914 tablet_replica.cc:442] T 89133749449947ec9f4704087e505a3a P 3584aa3de2e4435aab253c167083d071: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:45:16.647469 9915 tablet_replica.cc:439] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } }
I20260806 04:45:16.647720 9915 tablet_replica.cc:442] T 89133749449947ec9f4704087e505a3a P 1308f5e062c243938cab9785bfb6c985: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:45:16.653231 9916 tablet_replica.cc:439] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } }
I20260806 04:45:16.653653 9916 tablet_replica.cc:442] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda: This TxnStatusTablet replica's current role is: LEADER
I20260806 04:45:16.653174 9943 tablet_replica.cc:439] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } } }
I20260806 04:45:16.654964 9943 tablet_replica.cc:442] T 89133749449947ec9f4704087e505a3a P 0f2ee8ab80f644fdad6ee2cf22125cda: This TxnStatusTablet replica's current role is: LEADER
I20260806 04:45:16.661448 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.654407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55542 (local address 127.7.113.195:46547)
0806 04:45:16.654626 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.654632 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.654765 (+ 133us) server_negotiation.cc:407] Connection header received
0806 04:45:16.655730 (+ 965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.655737 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.655856 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.656011 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:16.656529 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.657285 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.659345 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.659727 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.659814 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.660351 (+ 537us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:16.660836 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:16.660940 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.661076 (+ 136us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.661144 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 04:45:16.677520 9907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.671217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:45883 (local address 127.7.113.193:42737)
0806 04:45:16.671395 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.671402 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.672050 (+ 648us) server_negotiation.cc:407] Connection header received
0806 04:45:16.672348 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.672357 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.672458 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.672510 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:16.673478 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.674313 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.675742 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.676165 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.676325 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.676767 (+ 442us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:16.676868 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:16.676990 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.677126 (+ 136us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.677200 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 04:45:16.677600 9949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.671251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:42737 (local address 127.7.113.195:45883)
0806 04:45:16.671942 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.671958 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.672141 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.672655 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.672658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.672667 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 04:45:16.673037 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.673053 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.674476 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.674488 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.675595 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.675607 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.676376 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.676385 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.676528 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.676575 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 04:45:16.676993 (+ 418us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 04:45:16.677007 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.677104 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.677232 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":364,"threads_started":1}
I20260806 04:45:16.688335 9557 raft_consensus.cc:1261] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Refusing update from remote peer 3584aa3de2e4435aab253c167083d071: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:16.688614 9698 raft_consensus.cc:1261] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Refusing update from remote peer 3584aa3de2e4435aab253c167083d071: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:16.689252 9918 consensus_queue.cc:1035] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:16.689904 9918 consensus_queue.cc:1035] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:16.700687 9937 mvcc.cc:205] Tried to move back new op lower bound from 7315421252348743680 to 7315421250655068160. Current Snapshot: MvccSnapshot[applied={T|T < 7315421252348743680}]
I20260806 04:45:16.726480 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.719705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:58501 (local address 127.7.113.195:46547)
0806 04:45:16.719897 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.719904 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.720675 (+ 771us) server_negotiation.cc:407] Connection header received
0806 04:45:16.720950 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.720956 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.721038 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.721121 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:16.721647 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.722581 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.724668 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.725090 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.725225 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.725691 (+ 466us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:16.725792 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:16.725918 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.726090 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.726191 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 04:45:16.726781 9954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.719827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:46547 (local address 127.7.113.193:58501)
0806 04:45:16.720557 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.720595 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.720804 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.721141 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.721146 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.721156 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 04:45:16.721481 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.721490 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.722719 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.722725 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.724532 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.724545 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.725281 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.725288 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.725443 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.725495 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 04:45:16.725952 (+ 457us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 04:45:16.725964 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.726063 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.726234 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":377,"threads_started":1}
I20260806 04:45:16.767416 9397 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:16.767711 9397 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:16.771680 9397 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304: Sending DeleteTablet for 3 replicas of tablet 7edd24b00e854a4fa1d453ab17937017
I20260806 04:45:16.772931 9678 tablet_service.cc:1514] Processing DeleteTablet for tablet 7edd24b00e854a4fa1d453ab17937017 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:16 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:52746
I20260806 04:45:16.773157 9818 tablet_service.cc:1514] Processing DeleteTablet for tablet 7edd24b00e854a4fa1d453ab17937017 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:16 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:55526
I20260806 04:45:16.774909 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet 7edd24b00e854a4fa1d453ab17937017 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:16 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:44362
I20260806 04:45:16.779693 9397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56344:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:45:16.781706 9397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:45:16.783849 9957 tablet_replica.cc:330] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985: stopping tablet replica
I20260806 04:45:16.784487 9957 raft_consensus.cc:2229] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:16.784940 9957 raft_consensus.cc:2258] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:16.786932 9957 ts_tablet_manager.cc:1905] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:16.792652 9678 tablet_service.cc:1467] Processing CreateTablet for tablet 41bb5d64e65e4d558d978a178c84eeb7 (DEFAULT_TABLE table=test-table [id=36ae0c79f4dc4afd8b760a25b616a88e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:16.793063 9678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41bb5d64e65e4d558d978a178c84eeb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:16.793206 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 41bb5d64e65e4d558d978a178c84eeb7 (DEFAULT_TABLE table=test-table [id=36ae0c79f4dc4afd8b760a25b616a88e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:16.793793 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41bb5d64e65e4d558d978a178c84eeb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:16.797086 9817 tablet_service.cc:1467] Processing CreateTablet for tablet 41bb5d64e65e4d558d978a178c84eeb7 (DEFAULT_TABLE table=test-table [id=36ae0c79f4dc4afd8b760a25b616a88e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:16.797550 9817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41bb5d64e65e4d558d978a178c84eeb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:16.799480 9908 tablet_bootstrap.cc:492] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985: Bootstrap starting.
I20260806 04:45:16.801110 9908 tablet_bootstrap.cc:654] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:16.804378 9910 tablet_bootstrap.cc:492] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071: Bootstrap starting.
I20260806 04:45:16.806383 9910 tablet_bootstrap.cc:654] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:16.809237 9909 tablet_bootstrap.cc:492] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: Bootstrap starting.
I20260806 04:45:16.809932 9957 ts_tablet_manager.cc:1918] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:45:16.810089 9957 log.cc:1196] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/7edd24b00e854a4fa1d453ab17937017
I20260806 04:45:16.810690 9957 ts_tablet_manager.cc:1939] T 7edd24b00e854a4fa1d453ab17937017 P 1308f5e062c243938cab9785bfb6c985: Deleting consensus metadata
I20260806 04:45:16.810992 9909 tablet_bootstrap.cc:654] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:16.811496 9959 tablet_replica.cc:330] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda: stopping tablet replica
I20260806 04:45:16.811980 9959 raft_consensus.cc:2229] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:16.812387 9959 raft_consensus.cc:2258] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:16.813344 9958 tablet_replica.cc:330] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071: stopping tablet replica
I20260806 04:45:16.813874 9958 raft_consensus.cc:2229] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:45:16.814687 9958 raft_consensus.cc:2258] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:16.814841 9959 ts_tablet_manager.cc:1905] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:16.820996 9958 ts_tablet_manager.cc:1905] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:16.822249 9908 tablet_bootstrap.cc:492] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985: No bootstrap required, opened a new log
I20260806 04:45:16.822228 9382 catalog_manager.cc:4841] TS 1308f5e062c243938cab9785bfb6c985 (127.7.113.194:44461): tablet 7edd24b00e854a4fa1d453ab17937017 (table test-table [id=a95c5b3be94d439a803175bf49a60302]) successfully deleted
I20260806 04:45:16.822427 9908 ts_tablet_manager.cc:1397] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.003s
I20260806 04:45:16.822796 9909 tablet_bootstrap.cc:492] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: No bootstrap required, opened a new log
I20260806 04:45:16.822955 9909 ts_tablet_manager.cc:1397] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.004s
I20260806 04:45:16.823279 9908 raft_consensus.cc:348] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.823542 9908 raft_consensus.cc:374] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:16.823630 9908 raft_consensus.cc:729] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1308f5e062c243938cab9785bfb6c985, State: Initialized, Role: FOLLOWER
I20260806 04:45:16.823632 9909 raft_consensus.cc:348] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.824038 9910 tablet_bootstrap.cc:492] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071: No bootstrap required, opened a new log
I20260806 04:45:16.824023 9909 raft_consensus.cc:374] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:16.823889 9908 consensus_queue.cc:260] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.824105 9909 raft_consensus.cc:729] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f2ee8ab80f644fdad6ee2cf22125cda, State: Initialized, Role: FOLLOWER
I20260806 04:45:16.824508 9908 ts_tablet_manager.cc:1428] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 04:45:16.824383 9909 consensus_queue.cc:260] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.825577 9909 ts_tablet_manager.cc:1428] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260806 04:45:16.829397 9915 raft_consensus.cc:482] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:16.829592 9915 raft_consensus.cc:504] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.830237 9910 ts_tablet_manager.cc:1397] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.008s
I20260806 04:45:16.831009 9910 raft_consensus.cc:348] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.831307 9910 raft_consensus.cc:374] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:16.831341 9915 leader_election.cc:288] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f2ee8ab80f644fdad6ee2cf22125cda (127.7.113.193:42737), 3584aa3de2e4435aab253c167083d071 (127.7.113.195:46547)
I20260806 04:45:16.831405 9910 raft_consensus.cc:729] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3584aa3de2e4435aab253c167083d071, State: Initialized, Role: FOLLOWER
I20260806 04:45:16.831681 9910 consensus_queue.cc:260] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.834911 9910 ts_tablet_manager.cc:1428] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260806 04:45:16.828845 9958 ts_tablet_manager.cc:1918] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:45:16.835948 9958 log.cc:1196] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/7edd24b00e854a4fa1d453ab17937017
I20260806 04:45:16.836563 9958 ts_tablet_manager.cc:1939] T 7edd24b00e854a4fa1d453ab17937017 P 3584aa3de2e4435aab253c167083d071: Deleting consensus metadata
I20260806 04:45:16.838150 9381 catalog_manager.cc:4841] TS 3584aa3de2e4435aab253c167083d071 (127.7.113.195:46547): tablet 7edd24b00e854a4fa1d453ab17937017 (table test-table [id=a95c5b3be94d439a803175bf49a60302]) successfully deleted
I20260806 04:45:16.841899 9959 ts_tablet_manager.cc:1918] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:45:16.842240 9959 log.cc:1196] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/7edd24b00e854a4fa1d453ab17937017
I20260806 04:45:16.842844 9959 ts_tablet_manager.cc:1939] T 7edd24b00e854a4fa1d453ab17937017 P 0f2ee8ab80f644fdad6ee2cf22125cda: Deleting consensus metadata
I20260806 04:45:16.844491 9381 catalog_manager.cc:4841] TS 0f2ee8ab80f644fdad6ee2cf22125cda (127.7.113.193:42737): tablet 7edd24b00e854a4fa1d453ab17937017 (table test-table [id=a95c5b3be94d439a803175bf49a60302]) successfully deleted
I20260806 04:45:16.852491 9907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.833512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:48629 (local address 127.7.113.193:42737)
0806 04:45:16.833719 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.833725 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.845050 (+ 11325us) server_negotiation.cc:407] Connection header received
0806 04:45:16.845319 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.845324 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.845399 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.845459 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:16.846264 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.847422 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.850032 (+ 2610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.851211 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.851353 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.851424 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.852022 (+ 598us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.852153 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 04:45:16.853456 9963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.831869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:42737 (local address 127.7.113.194:48629)
0806 04:45:16.844938 (+ 13069us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.844959 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.845172 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.845633 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.845637 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.845660 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:16.846053 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.846064 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.847609 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.847614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.849862 (+ 2248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.849879 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.851642 (+ 1763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.851648 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.851829 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.851866 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.852862 (+ 996us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.852990 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12926,"thread_start_us":12848,"threads_started":1}
I20260806 04:45:16.854717 9557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41bb5d64e65e4d558d978a178c84eeb7" candidate_uuid: "1308f5e062c243938cab9785bfb6c985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" is_pre_election: true
I20260806 04:45:16.854995 9557 raft_consensus.cc:2454] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1308f5e062c243938cab9785bfb6c985 in term 0.
I20260806 04:45:16.855487 9628 leader_election.cc:302] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f2ee8ab80f644fdad6ee2cf22125cda, 1308f5e062c243938cab9785bfb6c985; no voters:
I20260806 04:45:16.857569 9915 raft_consensus.cc:2781] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:45:16.857720 9915 raft_consensus.cc:482] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:45:16.857815 9915 raft_consensus.cc:3037] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:16.861986 9915 raft_consensus.cc:504] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.862757 9915 leader_election.cc:288] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [CANDIDATE]: Term 1 election: Requested vote from peers 0f2ee8ab80f644fdad6ee2cf22125cda (127.7.113.193:42737), 3584aa3de2e4435aab253c167083d071 (127.7.113.195:46547)
I20260806 04:45:16.863514 9557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41bb5d64e65e4d558d978a178c84eeb7" candidate_uuid: "1308f5e062c243938cab9785bfb6c985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda"
I20260806 04:45:16.863751 9557 raft_consensus.cc:3037] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:16.865612 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.845301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:33279 (local address 127.7.113.195:46547)
0806 04:45:16.845516 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.845524 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.854065 (+ 8541us) server_negotiation.cc:407] Connection header received
0806 04:45:16.855284 (+ 1219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.855289 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.855376 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.855439 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:16.856190 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.857384 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.862845 (+ 5461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.864395 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.864516 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.864587 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.865139 (+ 552us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.865296 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 04:45:16.866271 9964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.845303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:46547 (local address 127.7.113.194:33279)
0806 04:45:16.853796 (+ 8493us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.853816 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.854420 (+ 604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.855636 (+ 1216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.855641 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.855669 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:16.855989 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.856000 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.860599 (+ 4599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.860604 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.862633 (+ 2029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.862651 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.864776 (+ 2125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.864782 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.864955 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.864988 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.865790 (+ 802us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.865929 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8361,"thread_start_us":8757,"threads_started":1}
I20260806 04:45:16.867204 9843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41bb5d64e65e4d558d978a178c84eeb7" candidate_uuid: "1308f5e062c243938cab9785bfb6c985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3584aa3de2e4435aab253c167083d071" is_pre_election: true
I20260806 04:45:16.866954 9557 raft_consensus.cc:2454] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1308f5e062c243938cab9785bfb6c985 in term 1.
I20260806 04:45:16.867444 9843 raft_consensus.cc:2454] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1308f5e062c243938cab9785bfb6c985 in term 0.
I20260806 04:45:16.868124 9628 leader_election.cc:302] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f2ee8ab80f644fdad6ee2cf22125cda, 1308f5e062c243938cab9785bfb6c985; no voters:
I20260806 04:45:16.868584 9843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41bb5d64e65e4d558d978a178c84eeb7" candidate_uuid: "1308f5e062c243938cab9785bfb6c985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3584aa3de2e4435aab253c167083d071"
I20260806 04:45:16.868786 9843 raft_consensus.cc:3037] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:16.868891 9915 raft_consensus.cc:2781] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:16.872291 9843 raft_consensus.cc:2454] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1308f5e062c243938cab9785bfb6c985 in term 1.
I20260806 04:45:16.873054 9915 raft_consensus.cc:686] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [term 1 LEADER]: Becoming Leader. State: Replica: 1308f5e062c243938cab9785bfb6c985, State: Running, Role: LEADER
I20260806 04:45:16.873481 9915 consensus_queue.cc:237] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:16.878463 9396 catalog_manager.cc:5495] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1308f5e062c243938cab9785bfb6c985 (127.7.113.194). New cstate: current_term: 1 leader_uuid: "1308f5e062c243938cab9785bfb6c985" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } health_report { overall_health: UNKNOWN } } }
I20260806 04:45:16.911981 9904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.904647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52752 (local address 127.7.113.194:44461)
0806 04:45:16.904802 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.904808 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.904848 (+ 40us) server_negotiation.cc:407] Connection header received
0806 04:45:16.905067 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.905073 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.905166 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.905306 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:16.905839 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.906995 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.909044 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.909687 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.909809 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.910391 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:16.911024 (+ 633us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:16.911153 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.911622 (+ 469us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.911698 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 04:45:16.930573 9907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.922957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:54431 (local address 127.7.113.193:42737)
0806 04:45:16.923137 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.923143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.923967 (+ 824us) server_negotiation.cc:407] Connection header received
0806 04:45:16.924160 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.924166 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.924280 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.924381 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:16.924953 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.926054 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.928192 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.928932 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.929040 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.929797 (+ 757us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:16.929944 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:16.930050 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.930212 (+ 162us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.930299 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 04:45:16.930774 9969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.922847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:42737 (local address 127.7.113.194:54431)
0806 04:45:16.923652 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.923672 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.924014 (+ 342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.924399 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.924404 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.924417 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 04:45:16.924763 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.924774 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.926215 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.926221 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.928022 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.928037 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.929274 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.929280 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.929503 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.929570 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 04:45:16.930066 (+ 496us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 04:45:16.930079 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.930168 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.930300 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":440,"threads_started":1}
I20260806 04:45:16.942114 9843 raft_consensus.cc:1261] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Refusing update from remote peer 1308f5e062c243938cab9785bfb6c985: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:16.942399 9557 raft_consensus.cc:1261] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Refusing update from remote peer 1308f5e062c243938cab9785bfb6c985: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:16.943034 9965 consensus_queue.cc:1035] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:16.943492 9915 consensus_queue.cc:1035] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:16.957844 9939 mvcc.cc:205] Tried to move back new op lower bound from 7315421253386956800 to 7315421253117558784. Current Snapshot: MvccSnapshot[applied={T|T < 7315421253386956800}]
I20260806 04:45:16.992305 9954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.985292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:44461 (local address 127.7.113.193:51869)
0806 04:45:16.985798 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:16.985821 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:16.985942 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:16.986319 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:16.986326 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:16.986347 (+ 21us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 04:45:16.986554 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.986565 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.988005 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.988010 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.989795 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:16.989812 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.990999 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.991006 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:16.991213 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.991270 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 04:45:16.991749 (+ 479us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 04:45:16.991760 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 04:45:16.991836 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 04:45:16.991973 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323}
I20260806 04:45:16.993028 9904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:16.985531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:51869 (local address 127.7.113.194:44461)
0806 04:45:16.985989 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:16.985995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:16.986014 (+ 19us) server_negotiation.cc:407] Connection header received
0806 04:45:16.986075 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:16.986080 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:16.986177 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:16.986272 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:16.986741 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.987826 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.989975 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:16.990711 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:16.990838 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:16.991475 (+ 637us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:16.991607 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:16.991695 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:16.992656 (+ 961us) server_negotiation.cc:299] Negotiation successful
0806 04:45:16.992748 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329}
W20260806 04:45:16.994428 9939 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 04:45:18.626016 9396 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:18.626312 9396 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:18.630398 9396 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304: Sending DeleteTablet for 3 replicas of tablet 41bb5d64e65e4d558d978a178c84eeb7
I20260806 04:45:18.631085 9678 tablet_service.cc:1514] Processing DeleteTablet for tablet 41bb5d64e65e4d558d978a178c84eeb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:18 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:52746
I20260806 04:45:18.631074 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 41bb5d64e65e4d558d978a178c84eeb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:18 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:44362
I20260806 04:45:18.631556 9818 tablet_service.cc:1514] Processing DeleteTablet for tablet 41bb5d64e65e4d558d978a178c84eeb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:18 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:55526
I20260806 04:45:18.631781 9997 tablet_replica.cc:330] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: stopping tablet replica
I20260806 04:45:18.632023 9997 raft_consensus.cc:2229] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:18.632302 9997 raft_consensus.cc:2258] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:18.632858 9996 tablet_replica.cc:330] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985: stopping tablet replica
I20260806 04:45:18.633116 9996 raft_consensus.cc:2229] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:45:18.633708 9997 ts_tablet_manager.cc:1905] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:18.633697 9996 raft_consensus.cc:2258] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:18.634701 9996 ts_tablet_manager.cc:1905] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:18.642251 9996 ts_tablet_manager.cc:1918] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 04:45:18.642426 9996 log.cc:1196] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/41bb5d64e65e4d558d978a178c84eeb7
I20260806 04:45:18.642694 9997 ts_tablet_manager.cc:1918] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 04:45:18.642755 9998 tablet_replica.cc:330] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071: stopping tablet replica
I20260806 04:45:18.642886 9997 log.cc:1196] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/41bb5d64e65e4d558d978a178c84eeb7
I20260806 04:45:18.642956 9996 ts_tablet_manager.cc:1939] T 41bb5d64e65e4d558d978a178c84eeb7 P 1308f5e062c243938cab9785bfb6c985: Deleting consensus metadata
I20260806 04:45:18.643021 9998 raft_consensus.cc:2229] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:18.643294 9998 raft_consensus.cc:2258] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:18.643455 9997 ts_tablet_manager.cc:1939] T 41bb5d64e65e4d558d978a178c84eeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: Deleting consensus metadata
I20260806 04:45:18.644127 9382 catalog_manager.cc:4841] TS 1308f5e062c243938cab9785bfb6c985 (127.7.113.194:44461): tablet 41bb5d64e65e4d558d978a178c84eeb7 (table test-table [id=36ae0c79f4dc4afd8b760a25b616a88e]) successfully deleted
I20260806 04:45:18.644498 9998 ts_tablet_manager.cc:1905] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:18.644809 9381 catalog_manager.cc:4841] TS 0f2ee8ab80f644fdad6ee2cf22125cda (127.7.113.193:42737): tablet 41bb5d64e65e4d558d978a178c84eeb7 (table test-table [id=36ae0c79f4dc4afd8b760a25b616a88e]) successfully deleted
I20260806 04:45:18.649209 9998 ts_tablet_manager.cc:1918] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 04:45:18.649355 9998 log.cc:1196] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/41bb5d64e65e4d558d978a178c84eeb7
I20260806 04:45:18.649726 9998 ts_tablet_manager.cc:1939] T 41bb5d64e65e4d558d978a178c84eeb7 P 3584aa3de2e4435aab253c167083d071: Deleting consensus metadata
I20260806 04:45:18.650610 9381 catalog_manager.cc:4841] TS 3584aa3de2e4435aab253c167083d071 (127.7.113.195:46547): tablet 41bb5d64e65e4d558d978a178c84eeb7 (table test-table [id=36ae0c79f4dc4afd8b760a25b616a88e]) successfully deleted
Aug 06 04:45:18 dist-test-slave-0b58 krb5kdc[9351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991518, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 04:45:18 dist-test-slave-0b58 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991518, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:18.692366 10005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:18.673964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56360 (local address 127.7.113.254:38139)
0806 04:45:18.674933 (+ 969us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:18.674945 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:18.674965 (+ 20us) server_negotiation.cc:407] Connection header received
0806 04:45:18.675014 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:18.675017 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:18.675075 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:18.675206 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:18.676604 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:18.677461 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:18.678731 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:18.679169 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:18.679325 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:18.687641 (+ 8316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:18.687646 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:18.687649 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:18.687682 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:18.690163 (+ 2481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:18.690757 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:18.690760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:18.690763 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:18.690888 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:18.691190 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:18.691193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:18.691195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:18.691445 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:18.691612 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:18.691873 (+ 261us) server_negotiation.cc:299] Negotiation successful
0806 04:45:18.692039 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":817,"thread_start_us":639,"threads_started":1}
I20260806 04:45:18.695717 9396 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:45:18.696322 9396 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:45:18.702863 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 49020c8192374ceab6cd920e5da99e9e (DEFAULT_TABLE table=test-table [id=9baf8dddda8c40f7a5ca81dabd91ac99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:18.703049 9678 tablet_service.cc:1467] Processing CreateTablet for tablet 49020c8192374ceab6cd920e5da99e9e (DEFAULT_TABLE table=test-table [id=9baf8dddda8c40f7a5ca81dabd91ac99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:18.703351 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49020c8192374ceab6cd920e5da99e9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:18.703482 9678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49020c8192374ceab6cd920e5da99e9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:18.703454 9818 tablet_service.cc:1467] Processing CreateTablet for tablet 49020c8192374ceab6cd920e5da99e9e (DEFAULT_TABLE table=test-table [id=9baf8dddda8c40f7a5ca81dabd91ac99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:18.703874 9818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49020c8192374ceab6cd920e5da99e9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:18.709385 10007 tablet_bootstrap.cc:492] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071: Bootstrap starting.
I20260806 04:45:18.710665 10007 tablet_bootstrap.cc:654] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:18.711299 10009 tablet_bootstrap.cc:492] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda: Bootstrap starting.
I20260806 04:45:18.711874 10008 tablet_bootstrap.cc:492] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985: Bootstrap starting.
I20260806 04:45:18.713699 10008 tablet_bootstrap.cc:654] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:18.713760 10007 tablet_bootstrap.cc:492] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071: No bootstrap required, opened a new log
I20260806 04:45:18.713897 10007 ts_tablet_manager.cc:1397] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260806 04:45:18.714205 10009 tablet_bootstrap.cc:654] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:18.714887 10007 raft_consensus.cc:348] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:18.715147 10007 raft_consensus.cc:374] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:18.715250 10007 raft_consensus.cc:729] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3584aa3de2e4435aab253c167083d071, State: Initialized, Role: FOLLOWER
I20260806 04:45:18.715535 10007 consensus_queue.cc:260] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:18.716655 10007 ts_tablet_manager.cc:1428] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260806 04:45:18.716797 10008 tablet_bootstrap.cc:492] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985: No bootstrap required, opened a new log
I20260806 04:45:18.716836 10009 tablet_bootstrap.cc:492] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda: No bootstrap required, opened a new log
I20260806 04:45:18.716936 10008 ts_tablet_manager.cc:1397] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260806 04:45:18.716981 10009 ts_tablet_manager.cc:1397] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260806 04:45:18.717536 10008 raft_consensus.cc:348] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:18.717710 10008 raft_consensus.cc:374] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:18.717604 10009 raft_consensus.cc:348] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:18.717813 10008 raft_consensus.cc:729] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1308f5e062c243938cab9785bfb6c985, State: Initialized, Role: FOLLOWER
I20260806 04:45:18.717854 10009 raft_consensus.cc:374] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:18.717948 10009 raft_consensus.cc:729] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f2ee8ab80f644fdad6ee2cf22125cda, State: Initialized, Role: FOLLOWER
I20260806 04:45:18.718096 10008 consensus_queue.cc:260] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:18.718183 10009 consensus_queue.cc:260] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:18.718614 10008 ts_tablet_manager.cc:1428] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260806 04:45:18.718678 10009 ts_tablet_manager.cc:1428] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260806 04:45:18.902115 9991 raft_consensus.cc:482] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:18.902367 9991 raft_consensus.cc:504] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:18.903069 9991 leader_election.cc:288] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f2ee8ab80f644fdad6ee2cf22125cda (127.7.113.193:42737), 3584aa3de2e4435aab253c167083d071 (127.7.113.195:46547)
I20260806 04:45:18.903743 9557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49020c8192374ceab6cd920e5da99e9e" candidate_uuid: "1308f5e062c243938cab9785bfb6c985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" is_pre_election: true
I20260806 04:45:18.903785 9842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49020c8192374ceab6cd920e5da99e9e" candidate_uuid: "1308f5e062c243938cab9785bfb6c985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3584aa3de2e4435aab253c167083d071" is_pre_election: true
I20260806 04:45:18.904042 9557 raft_consensus.cc:2454] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1308f5e062c243938cab9785bfb6c985 in term 0.
I20260806 04:45:18.904042 9842 raft_consensus.cc:2454] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1308f5e062c243938cab9785bfb6c985 in term 0.
I20260806 04:45:18.904521 9628 leader_election.cc:302] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f2ee8ab80f644fdad6ee2cf22125cda, 1308f5e062c243938cab9785bfb6c985; no voters:
I20260806 04:45:18.904784 9991 raft_consensus.cc:2781] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:45:18.904909 9991 raft_consensus.cc:482] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:45:18.905010 9991 raft_consensus.cc:3037] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:18.906991 9991 raft_consensus.cc:504] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:18.907490 9991 leader_election.cc:288] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [CANDIDATE]: Term 1 election: Requested vote from peers 0f2ee8ab80f644fdad6ee2cf22125cda (127.7.113.193:42737), 3584aa3de2e4435aab253c167083d071 (127.7.113.195:46547)
I20260806 04:45:18.907950 9557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49020c8192374ceab6cd920e5da99e9e" candidate_uuid: "1308f5e062c243938cab9785bfb6c985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda"
I20260806 04:45:18.908030 9842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49020c8192374ceab6cd920e5da99e9e" candidate_uuid: "1308f5e062c243938cab9785bfb6c985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3584aa3de2e4435aab253c167083d071"
I20260806 04:45:18.908125 9557 raft_consensus.cc:3037] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:18.908321 9842 raft_consensus.cc:3037] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:18.910185 9557 raft_consensus.cc:2454] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1308f5e062c243938cab9785bfb6c985 in term 1.
I20260806 04:45:18.910401 9842 raft_consensus.cc:2454] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1308f5e062c243938cab9785bfb6c985 in term 1.
I20260806 04:45:18.910604 9628 leader_election.cc:302] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f2ee8ab80f644fdad6ee2cf22125cda, 1308f5e062c243938cab9785bfb6c985; no voters:
I20260806 04:45:18.910897 9991 raft_consensus.cc:2781] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:18.911051 9991 raft_consensus.cc:686] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [term 1 LEADER]: Becoming Leader. State: Replica: 1308f5e062c243938cab9785bfb6c985, State: Running, Role: LEADER
I20260806 04:45:18.911353 9991 consensus_queue.cc:237] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:18.914048 9397 catalog_manager.cc:5495] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1308f5e062c243938cab9785bfb6c985 (127.7.113.194). New cstate: current_term: 1 leader_uuid: "1308f5e062c243938cab9785bfb6c985" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } health_report { overall_health: UNKNOWN } } }
I20260806 04:45:18.955540 10016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:18.950538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52762 (local address 127.7.113.194:44461)
0806 04:45:18.951111 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:18.951116 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:18.951133 (+ 17us) server_negotiation.cc:407] Connection header received
0806 04:45:18.951181 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:18.951185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:18.951239 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:18.951326 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:18.951690 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:18.952571 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:18.953833 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:18.954272 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:18.954383 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:18.954826 (+ 443us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:18.954919 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:18.954989 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:18.955127 (+ 138us) server_negotiation.cc:299] Negotiation successful
0806 04:45:18.955202 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":335,"threads_started":1}
I20260806 04:45:18.963728 9557 raft_consensus.cc:1261] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Refusing update from remote peer 1308f5e062c243938cab9785bfb6c985: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:18.963779 9842 raft_consensus.cc:1261] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Refusing update from remote peer 1308f5e062c243938cab9785bfb6c985: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:18.964366 9991 consensus_queue.cc:1035] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:18.964646 9987 consensus_queue.cc:1035] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:19.009135 9397 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:19.009394 9397 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:19.012458 9397 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304: Sending DeleteTablet for 3 replicas of tablet 49020c8192374ceab6cd920e5da99e9e
I20260806 04:45:19.013339 9818 tablet_service.cc:1514] Processing DeleteTablet for tablet 49020c8192374ceab6cd920e5da99e9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:19 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:55526
I20260806 04:45:19.013433 9678 tablet_service.cc:1514] Processing DeleteTablet for tablet 49020c8192374ceab6cd920e5da99e9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:19 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:52746
I20260806 04:45:19.013588 9998 tablet_replica.cc:330] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071: stopping tablet replica
I20260806 04:45:19.013756 9996 tablet_replica.cc:330] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985: stopping tablet replica
I20260806 04:45:19.013787 9998 raft_consensus.cc:2229] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:19.013980 9998 raft_consensus.cc:2258] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:19.013947 9996 raft_consensus.cc:2229] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:45:19.014309 9996 raft_consensus.cc:2258] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:19.014439 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 49020c8192374ceab6cd920e5da99e9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:19 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:44362
I20260806 04:45:19.014668 9997 tablet_replica.cc:330] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda: stopping tablet replica
I20260806 04:45:19.014879 9997 raft_consensus.cc:2229] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:19.014792 9397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 04:45:19.015077 9997 raft_consensus.cc:2258] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Raft consensus is shut down!
W20260806 04:45:19.015522 9397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:45:19.015726 9996 ts_tablet_manager.cc:1905] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:19.016218 9998 ts_tablet_manager.cc:1905] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:19.022269 9996 ts_tablet_manager.cc:1918] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:45:19.023135 9536 tablet_service.cc:1467] Processing CreateTablet for tablet 6119abdd08544cbe83a35e359371aeb7 (DEFAULT_TABLE table=test-table [id=ac83f43ccb3a47669f57f4d72091511d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:19.023368 9678 tablet_service.cc:1467] Processing CreateTablet for tablet 6119abdd08544cbe83a35e359371aeb7 (DEFAULT_TABLE table=test-table [id=ac83f43ccb3a47669f57f4d72091511d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:19.023527 9536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6119abdd08544cbe83a35e359371aeb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:19.023909 9998 ts_tablet_manager.cc:1918] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:45:19.024078 9998 log.cc:1196] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/49020c8192374ceab6cd920e5da99e9e
I20260806 04:45:19.024569 9998 ts_tablet_manager.cc:1939] T 49020c8192374ceab6cd920e5da99e9e P 3584aa3de2e4435aab253c167083d071: Deleting consensus metadata
I20260806 04:45:19.025334 9997 ts_tablet_manager.cc:1905] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:19.028558 9381 catalog_manager.cc:4841] TS 3584aa3de2e4435aab253c167083d071 (127.7.113.195:46547): tablet 49020c8192374ceab6cd920e5da99e9e (table test-table [id=9baf8dddda8c40f7a5ca81dabd91ac99]) successfully deleted
I20260806 04:45:19.028975 9818 tablet_service.cc:1467] Processing CreateTablet for tablet 6119abdd08544cbe83a35e359371aeb7 (DEFAULT_TABLE table=test-table [id=ac83f43ccb3a47669f57f4d72091511d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:19.029140 9678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6119abdd08544cbe83a35e359371aeb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:19.029389 9818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6119abdd08544cbe83a35e359371aeb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:19.030889 9997 ts_tablet_manager.cc:1918] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:45:19.031038 9997 log.cc:1196] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/49020c8192374ceab6cd920e5da99e9e
I20260806 04:45:19.031448 9997 ts_tablet_manager.cc:1939] T 49020c8192374ceab6cd920e5da99e9e P 0f2ee8ab80f644fdad6ee2cf22125cda: Deleting consensus metadata
I20260806 04:45:19.032390 9996 log.cc:1196] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/49020c8192374ceab6cd920e5da99e9e
I20260806 04:45:19.032537 9381 catalog_manager.cc:4841] TS 0f2ee8ab80f644fdad6ee2cf22125cda (127.7.113.193:42737): tablet 49020c8192374ceab6cd920e5da99e9e (table test-table [id=9baf8dddda8c40f7a5ca81dabd91ac99]) successfully deleted
I20260806 04:45:19.032851 9996 ts_tablet_manager.cc:1939] T 49020c8192374ceab6cd920e5da99e9e P 1308f5e062c243938cab9785bfb6c985: Deleting consensus metadata
I20260806 04:45:19.034014 9382 catalog_manager.cc:4841] TS 1308f5e062c243938cab9785bfb6c985 (127.7.113.194:44461): tablet 49020c8192374ceab6cd920e5da99e9e (table test-table [id=9baf8dddda8c40f7a5ca81dabd91ac99]) successfully deleted
I20260806 04:45:19.034332 10009 tablet_bootstrap.cc:492] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: Bootstrap starting.
I20260806 04:45:19.034816 10008 tablet_bootstrap.cc:492] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985: Bootstrap starting.
I20260806 04:45:19.035537 10007 tablet_bootstrap.cc:492] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071: Bootstrap starting.
I20260806 04:45:19.035977 10009 tablet_bootstrap.cc:654] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:19.036162 10008 tablet_bootstrap.cc:654] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:19.037307 10007 tablet_bootstrap.cc:654] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:19.039448 10008 tablet_bootstrap.cc:492] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985: No bootstrap required, opened a new log
I20260806 04:45:19.039611 10007 tablet_bootstrap.cc:492] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071: No bootstrap required, opened a new log
I20260806 04:45:19.039616 10008 ts_tablet_manager.cc:1397] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 04:45:19.039841 10007 ts_tablet_manager.cc:1397] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.001s
I20260806 04:45:19.040423 10008 raft_consensus.cc:348] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:19.040583 10009 tablet_bootstrap.cc:492] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: No bootstrap required, opened a new log
I20260806 04:45:19.040683 10008 raft_consensus.cc:374] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:19.040756 10009 ts_tablet_manager.cc:1397] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.003s
I20260806 04:45:19.040772 10008 raft_consensus.cc:729] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1308f5e062c243938cab9785bfb6c985, State: Initialized, Role: FOLLOWER
I20260806 04:45:19.040591 10007 raft_consensus.cc:348] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:19.041132 10007 raft_consensus.cc:374] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:19.041014 10008 consensus_queue.cc:260] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:19.041285 10007 raft_consensus.cc:729] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3584aa3de2e4435aab253c167083d071, State: Initialized, Role: FOLLOWER
I20260806 04:45:19.041587 10008 ts_tablet_manager.cc:1428] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260806 04:45:19.041515 10009 raft_consensus.cc:348] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:19.041759 10009 raft_consensus.cc:374] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:19.041599 10007 consensus_queue.cc:260] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:19.041919 10009 raft_consensus.cc:729] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f2ee8ab80f644fdad6ee2cf22125cda, State: Initialized, Role: FOLLOWER
I20260806 04:45:19.042209 10009 consensus_queue.cc:260] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:19.042479 10007 ts_tablet_manager.cc:1428] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 04:45:19.042701 10009 ts_tablet_manager.cc:1428] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 04:45:19.078852 9972 raft_consensus.cc:482] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:19.079092 9972 raft_consensus.cc:504] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:19.079922 9972 leader_election.cc:288] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f2ee8ab80f644fdad6ee2cf22125cda (127.7.113.193:42737), 3584aa3de2e4435aab253c167083d071 (127.7.113.195:46547)
I20260806 04:45:19.080506 9557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6119abdd08544cbe83a35e359371aeb7" candidate_uuid: "1308f5e062c243938cab9785bfb6c985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" is_pre_election: true
I20260806 04:45:19.080629 9842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6119abdd08544cbe83a35e359371aeb7" candidate_uuid: "1308f5e062c243938cab9785bfb6c985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3584aa3de2e4435aab253c167083d071" is_pre_election: true
I20260806 04:45:19.080749 9557 raft_consensus.cc:2454] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1308f5e062c243938cab9785bfb6c985 in term 0.
I20260806 04:45:19.080960 9842 raft_consensus.cc:2454] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1308f5e062c243938cab9785bfb6c985 in term 0.
I20260806 04:45:19.081383 9628 leader_election.cc:302] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1308f5e062c243938cab9785bfb6c985, 3584aa3de2e4435aab253c167083d071; no voters:
I20260806 04:45:19.081676 9972 raft_consensus.cc:2781] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:45:19.081817 9972 raft_consensus.cc:482] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:45:19.081933 9972 raft_consensus.cc:3037] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:19.084024 9972 raft_consensus.cc:504] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:19.084556 9972 leader_election.cc:288] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [CANDIDATE]: Term 1 election: Requested vote from peers 0f2ee8ab80f644fdad6ee2cf22125cda (127.7.113.193:42737), 3584aa3de2e4435aab253c167083d071 (127.7.113.195:46547)
I20260806 04:45:19.085018 9557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6119abdd08544cbe83a35e359371aeb7" candidate_uuid: "1308f5e062c243938cab9785bfb6c985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda"
I20260806 04:45:19.085050 9842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6119abdd08544cbe83a35e359371aeb7" candidate_uuid: "1308f5e062c243938cab9785bfb6c985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3584aa3de2e4435aab253c167083d071"
I20260806 04:45:19.085253 9557 raft_consensus.cc:3037] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:19.085273 9842 raft_consensus.cc:3037] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:19.087635 9557 raft_consensus.cc:2454] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1308f5e062c243938cab9785bfb6c985 in term 1.
I20260806 04:45:19.088361 9842 raft_consensus.cc:2454] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1308f5e062c243938cab9785bfb6c985 in term 1.
I20260806 04:45:19.088438 9628 leader_election.cc:302] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f2ee8ab80f644fdad6ee2cf22125cda, 1308f5e062c243938cab9785bfb6c985; no voters:
I20260806 04:45:19.088760 9972 raft_consensus.cc:2781] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:19.088909 9972 raft_consensus.cc:686] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [term 1 LEADER]: Becoming Leader. State: Replica: 1308f5e062c243938cab9785bfb6c985, State: Running, Role: LEADER
I20260806 04:45:19.089159 9972 consensus_queue.cc:237] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } }
I20260806 04:45:19.091701 9395 catalog_manager.cc:5495] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1308f5e062c243938cab9785bfb6c985 (127.7.113.194). New cstate: current_term: 1 leader_uuid: "1308f5e062c243938cab9785bfb6c985" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1308f5e062c243938cab9785bfb6c985" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 } health_report { overall_health: UNKNOWN } } }
I20260806 04:45:19.117642 9557 raft_consensus.cc:1261] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Refusing update from remote peer 1308f5e062c243938cab9785bfb6c985: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:19.117956 9843 raft_consensus.cc:1261] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Refusing update from remote peer 1308f5e062c243938cab9785bfb6c985: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:19.118314 9972 consensus_queue.cc:1035] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f2ee8ab80f644fdad6ee2cf22125cda" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 42737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:19.118624 9987 consensus_queue.cc:1035] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3584aa3de2e4435aab253c167083d071" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 46547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 04:45:19.138401 9979 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 04:45:20.720279 9397 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:20.720523 9397 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:20.724406 9397 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3cd6b3ae1df74366aebd11989041e304: Sending DeleteTablet for 3 replicas of tablet 6119abdd08544cbe83a35e359371aeb7
I20260806 04:45:20.725188 9536 tablet_service.cc:1514] Processing DeleteTablet for tablet 6119abdd08544cbe83a35e359371aeb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:20 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:44362
I20260806 04:45:20.725471 9678 tablet_service.cc:1514] Processing DeleteTablet for tablet 6119abdd08544cbe83a35e359371aeb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:20 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:52746
I20260806 04:45:20.725455 9818 tablet_service.cc:1514] Processing DeleteTablet for tablet 6119abdd08544cbe83a35e359371aeb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:20 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:55526
I20260806 04:45:20.726127 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 9469
I20260806 04:45:20.736506 10050 tablet_replica.cc:330] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071: stopping tablet replica
I20260806 04:45:20.736732 10048 tablet_replica.cc:330] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: stopping tablet replica
I20260806 04:45:20.736871 10050 raft_consensus.cc:2229] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:20.737039 10048 raft_consensus.cc:2229] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:20.737190 10050 raft_consensus.cc:2258] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:20.737385 10048 raft_consensus.cc:2258] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:20.737785 10049 tablet_replica.cc:330] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985: stopping tablet replica
I20260806 04:45:20.738543 10050 ts_tablet_manager.cc:1905] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:20.738583 10048 ts_tablet_manager.cc:1905] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:20.738638 10049 raft_consensus.cc:2229] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:45:20.739107 10049 raft_consensus.cc:2258] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:20.740578 10049 ts_tablet_manager.cc:1905] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:20.745661 10050 ts_tablet_manager.cc:1918] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 04:45:20.745911 10050 log.cc:1196] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/6119abdd08544cbe83a35e359371aeb7
I20260806 04:45:20.746028 10048 ts_tablet_manager.cc:1918] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 04:45:20.746253 10048 log.cc:1196] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/6119abdd08544cbe83a35e359371aeb7
I20260806 04:45:20.746621 10050 ts_tablet_manager.cc:1939] T 6119abdd08544cbe83a35e359371aeb7 P 3584aa3de2e4435aab253c167083d071: Deleting consensus metadata
I20260806 04:45:20.746788 10048 ts_tablet_manager.cc:1939] T 6119abdd08544cbe83a35e359371aeb7 P 0f2ee8ab80f644fdad6ee2cf22125cda: Deleting consensus metadata
I20260806 04:45:20.747923 9381 catalog_manager.cc:4841] TS 3584aa3de2e4435aab253c167083d071 (127.7.113.195:46547): tablet 6119abdd08544cbe83a35e359371aeb7 (table test-table [id=ac83f43ccb3a47669f57f4d72091511d]) successfully deleted
I20260806 04:45:20.747961 10049 ts_tablet_manager.cc:1918] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 04:45:20.748103 10049 log.cc:1196] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/6119abdd08544cbe83a35e359371aeb7
Aug 06 04:45:20 dist-test-slave-0b58 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991518, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:45:20.748227 9381 catalog_manager.cc:4841] TS 0f2ee8ab80f644fdad6ee2cf22125cda (127.7.113.193:42737): tablet 6119abdd08544cbe83a35e359371aeb7 (table test-table [id=ac83f43ccb3a47669f57f4d72091511d]) successfully deleted
I20260806 04:45:20.748718 10049 ts_tablet_manager.cc:1939] T 6119abdd08544cbe83a35e359371aeb7 P 1308f5e062c243938cab9785bfb6c985: Deleting consensus metadata
I20260806 04:45:20.749812 9382 catalog_manager.cc:4841] TS 1308f5e062c243938cab9785bfb6c985 (127.7.113.194:44461): tablet 6119abdd08544cbe83a35e359371aeb7 (table test-table [id=ac83f43ccb3a47669f57f4d72091511d]) successfully deleted
I20260806 04:45:20.755050 10052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:20.728481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50242 (local address 127.7.113.193:42737)
0806 04:45:20.738009 (+ 9528us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:20.738014 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:20.738033 (+ 19us) server_negotiation.cc:407] Connection header received
0806 04:45:20.738085 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:20.738088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:20.738149 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:20.738276 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:20.740031 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:20.741261 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:20.743130 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:20.743811 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:20.744647 (+ 836us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:20.749410 (+ 4763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:20.749426 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:20.749442 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:20.749474 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:20.752628 (+ 3154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:20.753258 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:20.753265 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:20.753268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:20.753440 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:20.753833 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:20.753837 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:20.753838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:20.754162 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:20.754402 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:20.754632 (+ 230us) server_negotiation.cc:299] Negotiation successful
0806 04:45:20.754793 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9361,"thread_start_us":9258,"threads_started":1}
W20260806 04:45:20.755707 9602 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50242
W20260806 04:45:20.756313 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 9469: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:45:20.756536 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 9469
I20260806 04:45:20.781698 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 9611
Aug 06 04:45:20 dist-test-slave-0b58 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991518, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:45:20.796132 10053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:20.782495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36886 (local address 127.7.113.194:44461)
0806 04:45:20.783011 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:20.783015 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:20.783032 (+ 17us) server_negotiation.cc:407] Connection header received
0806 04:45:20.783086 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:20.783090 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:20.783147 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:20.783252 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:20.784560 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:20.785314 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:20.786524 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:20.786912 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:20.787005 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:20.791116 (+ 4111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:20.791129 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:20.791143 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:20.791178 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:20.793891 (+ 2713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:20.794478 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:20.794484 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:20.794487 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:20.794606 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:20.794914 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:20.794917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:20.794919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:20.795261 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:20.795477 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:20.795712 (+ 235us) server_negotiation.cc:299] Negotiation successful
0806 04:45:20.795875 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":289,"threads_started":1}
W20260806 04:45:20.796793 9743 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36886
W20260806 04:45:20.797374 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 9611: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:45:20.797518 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 9611
I20260806 04:45:20.822400 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 9752
Aug 06 04:45:20 dist-test-slave-0b58 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991518, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:45:20.837961 10054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:20.823111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37082 (local address 127.7.113.195:46547)
0806 04:45:20.823664 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:20.823668 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:20.823685 (+ 17us) server_negotiation.cc:407] Connection header received
0806 04:45:20.823741 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:20.823752 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:20.823811 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:20.823904 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:20.825267 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:20.826157 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:20.827449 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:20.827845 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:20.827937 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:20.832680 (+ 4743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:20.832696 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:20.832714 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:20.832752 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:20.835423 (+ 2671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:20.836082 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:20.836089 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:20.836091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:20.836242 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:20.836627 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:20.836630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:20.836632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:20.836985 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:20.837205 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:20.837525 (+ 320us) server_negotiation.cc:299] Negotiation successful
0806 04:45:20.837697 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":306,"threads_started":1}
W20260806 04:45:20.838620 9883 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37082
W20260806 04:45:20.839213 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 9752: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:45:20.839347 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 9752
I20260806 04:45:20.864084 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 9365
I20260806 04:45:20.865515 9438 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:20.981362 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 9365
2026-08-06T04:45:21Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9025 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:45:21 dist-test-slave-0b58 krb5kdc[10058](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:45:21 dist-test-slave-0b58 krb5kdc[10058](info): set up 2 sockets
Aug 06 04:45:21 dist-test-slave-0b58 krb5kdc[10058](info): commencing operation
krb5kdc: starting...
W20260806 04:45:22.070745 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.004s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:45:22 dist-test-slave-0b58 krb5kdc[10058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:45:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:45:22.285727 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:34949
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:34949
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:22.607936 10071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:22.608227 10071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:22.608407 10071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:22.615738 10071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:22.615845 10071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:22.615926 10071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:22.616019 10071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:22.616104 10071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:45:22.626084 10071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:34949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:34949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:22.627467 10071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:22.628865 10071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:22.641010 10076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:22.640944 10077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:22.640978 10079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:22.641712 10071 server_base.cc:1034] running on GCE node
I20260806 04:45:22.642504 10071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:22.643886 10071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:22.645112 10071 hybrid_clock.cc:648] HybridClock initialized: now 1785991522645069 us; error 32 us; skew 500 ppm
I20260806 04:45:22.645462 10071 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:22 dist-test-slave-0b58 krb5kdc[10058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991522, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:22.648497 10071 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:45:22.649917 10071 webserver.cc:460] Webserver started at http://127.7.113.254:37857/ using document root <none> and password file <none>
I20260806 04:45:22.650552 10071 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:22.650645 10071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:22.650889 10071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:22.653795 10071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "00485ce40b8740f9985c85e283ef53a3"
format_stamp: "Formatted at 2026-08-06 04:45:22 on dist-test-slave-0b58"
server_key: "bd05733ab59bcd0078e83464fce99509"
server_key_iv: "4de18ac8f34a3c0e0ae8a1cc7ccff693"
server_key_version: "encryptionkey@0"
I20260806 04:45:22.654525 10071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "00485ce40b8740f9985c85e283ef53a3"
format_stamp: "Formatted at 2026-08-06 04:45:22 on dist-test-slave-0b58"
server_key: "bd05733ab59bcd0078e83464fce99509"
server_key_iv: "4de18ac8f34a3c0e0ae8a1cc7ccff693"
server_key_version: "encryptionkey@0"
I20260806 04:45:22.659219 10071 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 04:45:22.662362 10086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:22.663614 10071 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 04:45:22.663765 10071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "00485ce40b8740f9985c85e283ef53a3"
format_stamp: "Formatted at 2026-08-06 04:45:22 on dist-test-slave-0b58"
server_key: "bd05733ab59bcd0078e83464fce99509"
server_key_iv: "4de18ac8f34a3c0e0ae8a1cc7ccff693"
server_key_version: "encryptionkey@0"
I20260806 04:45:22.663918 10071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:22.674341 10071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:22.678141 10071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:22.678377 10071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:22.697433 10071 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:34949
I20260806 04:45:22.697474 10138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:34949 every 8 connection(s)
I20260806 04:45:22.698866 10071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:22.702656 10139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:22.704340 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 10071
I20260806 04:45:22.704572 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:22.705443 7623 external_mini_cluster.cc:1428] Setting key 972f59109fb1e72a52c21e4ed6c3bf23
I20260806 04:45:22.717602 10139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3: Bootstrap starting.
Aug 06 04:45:22 dist-test-slave-0b58 krb5kdc[10058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:22.721218 10139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:22.722270 10139 log.cc:824] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:22.725178 10139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3: No bootstrap required, opened a new log
I20260806 04:45:22.728829 10142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:22.707521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55370 (local address 127.7.113.254:34949)
0806 04:45:22.708359 (+ 838us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:22.708374 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:22.708421 (+ 47us) server_negotiation.cc:407] Connection header received
0806 04:45:22.709937 (+ 1516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:22.709962 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:22.710330 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:22.710637 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:22.712444 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:22.713719 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:22.715511 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:22.716175 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:22.716372 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:22.720988 (+ 4616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:22.720996 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:22.721010 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:22.721045 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:22.724112 (+ 3067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:22.724827 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:22.724833 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:22.724839 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:22.725000 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:22.725434 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:22.725439 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:22.725443 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:22.726159 (+ 716us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:22.726490 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:22.726866 (+ 376us) server_negotiation.cc:299] Negotiation successful
0806 04:45:22.727327 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":359,"threads_started":1}
I20260806 04:45:22.734022 10139 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00485ce40b8740f9985c85e283ef53a3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 34949 } }
I20260806 04:45:22.734340 10139 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:22.734416 10139 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00485ce40b8740f9985c85e283ef53a3, State: Initialized, Role: FOLLOWER
I20260806 04:45:22.734879 10139 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00485ce40b8740f9985c85e283ef53a3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 34949 } }
I20260806 04:45:22.735105 10139 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:22.735246 10139 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:22.735435 10139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:22.737645 10139 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00485ce40b8740f9985c85e283ef53a3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 34949 } }
I20260806 04:45:22.738121 10139 leader_election.cc:302] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00485ce40b8740f9985c85e283ef53a3; no voters:
I20260806 04:45:22.738708 10139 leader_election.cc:288] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:22.738839 10144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:22.739554 10144 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [term 1 LEADER]: Becoming Leader. State: Replica: 00485ce40b8740f9985c85e283ef53a3, State: Running, Role: LEADER
I20260806 04:45:22.740087 10144 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00485ce40b8740f9985c85e283ef53a3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 34949 } }
I20260806 04:45:22.740810 10139 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:22.742715 10145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00485ce40b8740f9985c85e283ef53a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00485ce40b8740f9985c85e283ef53a3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 34949 } } }
I20260806 04:45:22.743119 10145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:22.744004 10152 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:22.743868 10146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00485ce40b8740f9985c85e283ef53a3. Latest consensus state: current_term: 1 leader_uuid: "00485ce40b8740f9985c85e283ef53a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00485ce40b8740f9985c85e283ef53a3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 34949 } } }
I20260806 04:45:22.744239 10146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:22.750046 10152 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:22.758164 10152 catalog_manager.cc:1347] Generated new cluster ID: 74315c448a774a9b89d5b7ba428dd7ba
I20260806 04:45:22.758275 10152 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:22.771184 10152 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:22.773058 10152 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:22.796785 10152 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00485ce40b8740f9985c85e283ef53a3: Generated new TSK 0
I20260806 04:45:22.797897 10152 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:45:22.848672 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:34949
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:23.177561 10165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:23.177835 10165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:23.177987 10165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:23.185480 10165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:23.185600 10165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:23.185807 10165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:45:23.195433 10165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:34949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:23.196810 10165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:23.198181 10165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:23.210839 10170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:23.211000 10171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:23.211454 10173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:23.211884 10165 server_base.cc:1034] running on GCE node
I20260806 04:45:23.212540 10165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:23.213472 10165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:23.214665 10165 hybrid_clock.cc:648] HybridClock initialized: now 1785991523214607 us; error 55 us; skew 500 ppm
I20260806 04:45:23.214972 10165 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:23 dist-test-slave-0b58 krb5kdc[10058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991523, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:23.218204 10165 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:45:23.219672 10165 webserver.cc:460] Webserver started at http://127.7.113.193:35077/ using document root <none> and password file <none>
I20260806 04:45:23.220434 10165 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:23.220592 10165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:23.220898 10165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:23.223850 10165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "24e3ea506bba4f969eb6e5912c965204"
format_stamp: "Formatted at 2026-08-06 04:45:23 on dist-test-slave-0b58"
server_key: "4942853bef47b3b44340295d9cc9650e"
server_key_iv: "b5de43b07d369b6626cefdd97a8622c7"
server_key_version: "encryptionkey@0"
I20260806 04:45:23.224663 10165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "24e3ea506bba4f969eb6e5912c965204"
format_stamp: "Formatted at 2026-08-06 04:45:23 on dist-test-slave-0b58"
server_key: "4942853bef47b3b44340295d9cc9650e"
server_key_iv: "b5de43b07d369b6626cefdd97a8622c7"
server_key_version: "encryptionkey@0"
I20260806 04:45:23.230218 10165 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:45:23.233558 10180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:23.234786 10165 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:45:23.234958 10165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "24e3ea506bba4f969eb6e5912c965204"
format_stamp: "Formatted at 2026-08-06 04:45:23 on dist-test-slave-0b58"
server_key: "4942853bef47b3b44340295d9cc9650e"
server_key_iv: "b5de43b07d369b6626cefdd97a8622c7"
server_key_version: "encryptionkey@0"
I20260806 04:45:23.235149 10165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:23.247916 10165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:23.252043 10165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:23.252385 10165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:23.253331 10165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:23.254607 10165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:23.254709 10165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:23.254849 10165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:23.254920 10165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:23.289611 10165 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:39845
I20260806 04:45:23.289696 10292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:39845 every 8 connection(s)
I20260806 04:45:23.290874 10165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:45:23.299238 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 10165
I20260806 04:45:23.299468 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:45:23.300408 7623 external_mini_cluster.cc:1428] Setting key 6368af11c56d999e696a0377b6e34f24
Aug 06 04:45:23 dist-test-slave-0b58 krb5kdc[10058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991523, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:23.312485 10295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:23.293464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:34223 (local address 127.7.113.254:34949)
0806 04:45:23.293887 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:23.293892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:23.294844 (+ 952us) server_negotiation.cc:407] Connection header received
0806 04:45:23.296727 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:23.296733 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:23.296835 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:23.296983 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:23.298478 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:23.299227 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:23.301675 (+ 2448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:23.302316 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:23.302445 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:23.306728 (+ 4283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:23.306734 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:23.306737 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:23.306769 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:23.309431 (+ 2662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:23.310157 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:23.310163 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:23.310167 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:23.310296 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:23.310740 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:23.310746 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:23.310749 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:23.311010 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:23.311181 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:23.311862 (+ 681us) server_negotiation.cc:299] Negotiation successful
0806 04:45:23.312082 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":192,"threads_started":1}
I20260806 04:45:23.313465 10296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:23.293983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:34949 (local address 127.7.113.193:34223)
0806 04:45:23.294677 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:23.294719 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:23.296464 (+ 1745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:23.297234 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:23.297243 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:23.297741 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:23.298292 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:23.298310 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:23.299661 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:23.299667 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:23.301529 (+ 1862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:23.301542 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:23.302582 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:23.302589 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:23.302886 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:23.303674 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:23.303708 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:23.306480 (+ 2772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:23.309579 (+ 3099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:23.309588 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:23.309604 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:23.310025 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:23.310412 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:23.310417 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:23.310421 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:23.310614 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:23.311141 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:23.311160 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:23.311488 (+ 328us) client_negotiation.cc:769] Sending connection context
0806 04:45:23.311750 (+ 262us) client_negotiation.cc:240] Negotiation successful
0806 04:45:23.312340 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":278,"threads_started":1}
I20260806 04:45:23.315018 10293 heartbeater.cc:347] Connected to a master server at 127.7.113.254:34949
I20260806 04:45:23.315354 10293 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:23.316215 10293 heartbeater.cc:511] Master 127.7.113.254:34949 requested a full tablet report, sending...
I20260806 04:45:23.318693 10104 ts_manager.cc:194] Registered new tserver with Master: 24e3ea506bba4f969eb6e5912c965204 (127.7.113.193:39845)
I20260806 04:45:23.320976 10104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:34223
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:45:23.351758 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:34949
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:23.677695 10299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:23.677974 10299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:23.678073 10299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:23.685261 10299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:23.685369 10299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:23.685482 10299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:45:23.695564 10299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:34949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:23.697069 10299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:23.698726 10299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:23.714845 10304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:23.714802 10305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:23.715495 10307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:23.715752 10299 server_base.cc:1034] running on GCE node
I20260806 04:45:23.716464 10299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:23.717527 10299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:23.718761 10299 hybrid_clock.cc:648] HybridClock initialized: now 1785991523718724 us; error 50 us; skew 500 ppm
I20260806 04:45:23.719085 10299 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:23 dist-test-slave-0b58 krb5kdc[10058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991523, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:23.726455 10299 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:45:23.728048 10299 webserver.cc:460] Webserver started at http://127.7.113.194:42455/ using document root <none> and password file <none>
I20260806 04:45:23.728809 10299 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:23.728960 10299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:23.729280 10299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:23.732328 10299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "ee63fe3346974ceba914e8d83ae2dcc4"
format_stamp: "Formatted at 2026-08-06 04:45:23 on dist-test-slave-0b58"
server_key: "91df40fd42f2775b7d961aa001843570"
server_key_iv: "0071406e4863fc1ea44b4f98b2df5eed"
server_key_version: "encryptionkey@0"
I20260806 04:45:23.733271 10299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "ee63fe3346974ceba914e8d83ae2dcc4"
format_stamp: "Formatted at 2026-08-06 04:45:23 on dist-test-slave-0b58"
server_key: "91df40fd42f2775b7d961aa001843570"
server_key_iv: "0071406e4863fc1ea44b4f98b2df5eed"
server_key_version: "encryptionkey@0"
I20260806 04:45:23.738380 10299 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:45:23.742092 10314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:23.743453 10299 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 04:45:23.743635 10299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "ee63fe3346974ceba914e8d83ae2dcc4"
format_stamp: "Formatted at 2026-08-06 04:45:23 on dist-test-slave-0b58"
server_key: "91df40fd42f2775b7d961aa001843570"
server_key_iv: "0071406e4863fc1ea44b4f98b2df5eed"
server_key_version: "encryptionkey@0"
I20260806 04:45:23.743849 10299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:23.778355 10299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:23.782706 10299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:23.783036 10299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:23.784047 10299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:23.785446 10299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:23.785553 10299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:23.785713 10299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:23.785789 10299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:23.819903 10299 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:36731
I20260806 04:45:23.819995 10426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:36731 every 8 connection(s)
I20260806 04:45:23.821302 10299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:45:23.823261 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 10299
I20260806 04:45:23.823496 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:45:23.824056 7623 external_mini_cluster.cc:1428] Setting key bbf56ad768d85d7157bc308a2bae1f5a
Aug 06 04:45:23 dist-test-slave-0b58 krb5kdc[10058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991523, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:23.845933 10429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:23.824113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:55207 (local address 127.7.113.254:34949)
0806 04:45:23.824651 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:23.824658 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:23.825703 (+ 1045us) server_negotiation.cc:407] Connection header received
0806 04:45:23.828391 (+ 2688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:23.828396 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:23.828462 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:23.828556 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:23.830737 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:23.831460 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:23.833955 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:23.834528 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:23.834667 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:23.838362 (+ 3695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:23.838371 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:23.838379 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:23.838425 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:23.842372 (+ 3947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:23.843112 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:23.843153 (+ 41us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:23.843160 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:23.843326 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:23.843856 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:23.843863 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:23.843866 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:23.844324 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:23.844488 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:23.845191 (+ 703us) server_negotiation.cc:299] Negotiation successful
0806 04:45:23.845455 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":272,"threads_started":1}
I20260806 04:45:23.846689 10430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:23.824685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:34949 (local address 127.7.113.194:55207)
0806 04:45:23.825546 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:23.825590 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:23.828065 (+ 2475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:23.828864 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:23.828880 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:23.829667 (+ 787us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:23.830530 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:23.830562 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:23.831614 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:23.831623 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:23.833799 (+ 2176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:23.833825 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:23.834744 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:23.834749 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:23.834958 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:23.835679 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:23.835701 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:23.838108 (+ 2407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:23.842507 (+ 4399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:23.842514 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:23.842527 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:23.842968 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:23.843479 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:23.843483 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:23.843486 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:23.843724 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:23.844468 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:23.844474 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:23.844789 (+ 315us) client_negotiation.cc:769] Sending connection context
0806 04:45:23.845021 (+ 232us) client_negotiation.cc:240] Negotiation successful
0806 04:45:23.845548 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":357,"threads_started":1}
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
I20260806 04:45:23.848305 10427 heartbeater.cc:347] Connected to a master server at 127.7.113.254:34949
I20260806 04:45:23.848672 10427 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:23.849351 10427 heartbeater.cc:511] Master 127.7.113.254:34949 requested a full tablet report, sending...
I20260806 04:45:23.850742 10104 ts_manager.cc:194] Registered new tserver with Master: ee63fe3346974ceba914e8d83ae2dcc4 (127.7.113.194:36731)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
I20260806 04:45:23.851874 10104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:55207
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:45:23.877876 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:34949
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:24.201915 10433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:24.202189 10433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:24.202291 10433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:24.209352 10433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:24.209453 10433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:24.209565 10433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:45:24.218885 10433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:34949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:24.220010 10433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:24.221268 10433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:24.236825 10441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:24.236857 10438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:24.236899 10439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:24.237646 10433 server_base.cc:1034] running on GCE node
I20260806 04:45:24.238162 10433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:24.239096 10433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:24.240368 10433 hybrid_clock.cc:648] HybridClock initialized: now 1785991524240317 us; error 44 us; skew 500 ppm
I20260806 04:45:24.240679 10433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:24 dist-test-slave-0b58 krb5kdc[10058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991524, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:24.243747 10433 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:45:24.245234 10433 webserver.cc:460] Webserver started at http://127.7.113.195:39685/ using document root <none> and password file <none>
I20260806 04:45:24.245958 10433 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:24.246090 10433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:24.246439 10433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:24.249532 10433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "4981e9fc298e453385552da9b79267a5"
format_stamp: "Formatted at 2026-08-06 04:45:24 on dist-test-slave-0b58"
server_key: "fe765d61f4fee103f04b357876b401ce"
server_key_iv: "b05534f4cea77f56910cfe1ba3d699e7"
server_key_version: "encryptionkey@0"
I20260806 04:45:24.250324 10433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "4981e9fc298e453385552da9b79267a5"
format_stamp: "Formatted at 2026-08-06 04:45:24 on dist-test-slave-0b58"
server_key: "fe765d61f4fee103f04b357876b401ce"
server_key_iv: "b05534f4cea77f56910cfe1ba3d699e7"
server_key_version: "encryptionkey@0"
I20260806 04:45:24.255409 10433 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 04:45:24.258764 10448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:24.259967 10433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:45:24.260143 10433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "4981e9fc298e453385552da9b79267a5"
format_stamp: "Formatted at 2026-08-06 04:45:24 on dist-test-slave-0b58"
server_key: "fe765d61f4fee103f04b357876b401ce"
server_key_iv: "b05534f4cea77f56910cfe1ba3d699e7"
server_key_version: "encryptionkey@0"
I20260806 04:45:24.260412 10433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:24.298502 10433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:24.302805 10433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:24.303107 10433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:24.304124 10433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:24.305467 10433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:24.305579 10433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:24.305733 10433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:24.305816 10433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:24.324683 10293 heartbeater.cc:503] Master 127.7.113.254:34949 was elected leader, sending a full tablet report...
I20260806 04:45:24.341377 10433 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:45081
I20260806 04:45:24.341460 10561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:45081 every 8 connection(s)
I20260806 04:45:24.342751 10433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:45:24.348738 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 10433
I20260806 04:45:24.348915 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:45:24.349363 7623 external_mini_cluster.cc:1428] Setting key d45c774bded4cb29da611f525c9e2be4
Aug 06 04:45:24 dist-test-slave-0b58 krb5kdc[10058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991524, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:24.362217 10429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:24.345447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:45349 (local address 127.7.113.254:34949)
0806 04:45:24.345673 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:24.345679 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:24.346821 (+ 1142us) server_negotiation.cc:407] Connection header received
0806 04:45:24.348797 (+ 1976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:24.348804 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:24.348917 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:24.349041 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:24.350547 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:24.351295 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:24.352942 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:24.353337 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:24.353477 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:24.356830 (+ 3353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:24.356835 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:24.356838 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:24.356868 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:24.359215 (+ 2347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:24.359915 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:24.359920 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:24.359923 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:24.360042 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:24.360543 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:24.360547 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:24.360549 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:24.360818 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:24.360983 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:24.361643 (+ 660us) server_negotiation.cc:299] Negotiation successful
0806 04:45:24.361875 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 04:45:24.363229 10564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:24.345933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:34949 (local address 127.7.113.195:45349)
0806 04:45:24.346664 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:24.346706 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:24.348532 (+ 1826us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:24.349287 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:24.349295 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:24.349836 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:24.350377 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:24.350395 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:24.351468 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:24.351472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:24.352801 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:24.352813 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:24.353552 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:24.353559 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:24.353794 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:24.354455 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:24.354476 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:24.356620 (+ 2144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:24.359356 (+ 2736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:24.359364 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:24.359379 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:24.359783 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:24.360154 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:24.360159 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:24.360163 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:24.360417 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:24.360952 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:24.360959 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:24.361288 (+ 329us) client_negotiation.cc:769] Sending connection context
0806 04:45:24.361536 (+ 248us) client_negotiation.cc:240] Negotiation successful
0806 04:45:24.362022 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":336,"threads_started":1}
I20260806 04:45:24.364658 10562 heartbeater.cc:347] Connected to a master server at 127.7.113.254:34949
I20260806 04:45:24.364966 10562 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:24.365705 10562 heartbeater.cc:511] Master 127.7.113.254:34949 requested a full tablet report, sending...
I20260806 04:45:24.367309 10103 ts_manager.cc:194] Registered new tserver with Master: 4981e9fc298e453385552da9b79267a5 (127.7.113.195:45081)
I20260806 04:45:24.368405 10103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:45349
I20260806 04:45:24.376936 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 04:45:24.413054 10429 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:45:24.410423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55380 (local address 127.7.113.254:34949)
0806 04:45:24.410634 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:24.410641 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:24.411061 (+ 420us) server_negotiation.cc:407] Connection header received
0806 04:45:24.411286 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:24.411290 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:24.411356 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:24.411465 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:24.412747 (+ 1282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55380: BlockingRecv error: recv got EOF from 127.0.0.1:55380 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 04:45:24.416112 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 10165
W20260806 04:45:24.418854 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 10165: Not authorized: Client connection negotiation failed: client connection to 127.7.113.193:39845: server requires authentication, but client does not have Kerberos credentials available
I20260806 04:45:24.419060 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 10165
I20260806 04:45:24.436299 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 10299
W20260806 04:45:24.438859 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 10299: Not authorized: Client connection negotiation failed: client connection to 127.7.113.194:36731: server requires authentication, but client does not have Kerberos credentials available
I20260806 04:45:24.438997 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 10299
I20260806 04:45:24.455355 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 10433
W20260806 04:45:24.458226 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 10433: Not authorized: Client connection negotiation failed: client connection to 127.7.113.195:45081: server requires authentication, but client does not have Kerberos credentials available
I20260806 04:45:24.458413 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 10433
I20260806 04:45:24.475864 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 10071
I20260806 04:45:24.476974 10134 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:24.579427 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 10071
2026-08-06T04:45:24Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3594 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:45:24 dist-test-slave-0b58 krb5kdc[10579](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:45:24 dist-test-slave-0b58 krb5kdc[10579](info): set up 2 sockets
Aug 06 04:45:24 dist-test-slave-0b58 krb5kdc[10579](info): commencing operation
krb5kdc: starting...
W20260806 04:45:25.666782 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.001s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:45:25 dist-test-slave-0b58 krb5kdc[10579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991525, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:45:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:45:25.871613 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:39897
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:39897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:26.189345 10592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:26.189640 10592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:26.189749 10592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:26.196902 10592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:26.196995 10592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:26.197079 10592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:26.197155 10592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:26.197273 10592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:45:26.206926 10592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:39897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:39897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:26.208187 10592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:26.209537 10592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:26.221401 10597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:26.221339 10598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:26.221338 10600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:26.222088 10592 server_base.cc:1034] running on GCE node
I20260806 04:45:26.222905 10592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:26.227758 10592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:26.229066 10592 hybrid_clock.cc:648] HybridClock initialized: now 1785991526228941 us; error 93 us; skew 500 ppm
I20260806 04:45:26.229477 10592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:26 dist-test-slave-0b58 krb5kdc[10579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991526, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:26.233649 10592 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:45:26.235455 10592 webserver.cc:460] Webserver started at http://127.7.113.254:37951/ using document root <none> and password file <none>
I20260806 04:45:26.236141 10592 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:26.236250 10592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:26.236629 10592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:26.239527 10592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "38049274a81a49419162201dba3a635c"
format_stamp: "Formatted at 2026-08-06 04:45:26 on dist-test-slave-0b58"
server_key: "938bc57413fbe3d8647ab3029cba3d93"
server_key_iv: "1fe062c688846e977a5092b1a7d151ca"
server_key_version: "encryptionkey@0"
I20260806 04:45:26.240245 10592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "38049274a81a49419162201dba3a635c"
format_stamp: "Formatted at 2026-08-06 04:45:26 on dist-test-slave-0b58"
server_key: "938bc57413fbe3d8647ab3029cba3d93"
server_key_iv: "1fe062c688846e977a5092b1a7d151ca"
server_key_version: "encryptionkey@0"
I20260806 04:45:26.245179 10592 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:45:26.248399 10607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:26.249629 10592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:45:26.249815 10592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "38049274a81a49419162201dba3a635c"
format_stamp: "Formatted at 2026-08-06 04:45:26 on dist-test-slave-0b58"
server_key: "938bc57413fbe3d8647ab3029cba3d93"
server_key_iv: "1fe062c688846e977a5092b1a7d151ca"
server_key_version: "encryptionkey@0"
I20260806 04:45:26.250020 10592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:26.264946 10592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:26.268671 10592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:26.268949 10592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:26.286520 10592 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:39897
I20260806 04:45:26.286557 10658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:39897 every 8 connection(s)
I20260806 04:45:26.287863 10592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:26.290194 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 10592
I20260806 04:45:26.290437 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:26.291234 7623 external_mini_cluster.cc:1428] Setting key b9a1ef5e39d1c9f24e509928b69017b9
I20260806 04:45:26.292078 10659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 04:45:26 dist-test-slave-0b58 krb5kdc[10579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991525, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:26.305778 10659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c: Bootstrap starting.
I20260806 04:45:26.309697 10659 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:26.310921 10659 log.cc:824] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:26.314204 10659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c: No bootstrap required, opened a new log
I20260806 04:45:26.314718 10662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:26.293128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49552 (local address 127.7.113.254:39897)
0806 04:45:26.293940 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:26.293954 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:26.294004 (+ 50us) server_negotiation.cc:407] Connection header received
0806 04:45:26.295703 (+ 1699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:26.295728 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:26.296211 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:26.296664 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:26.298042 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:26.300058 (+ 2016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:26.301357 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:26.302372 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:26.302557 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:26.306445 (+ 3888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:26.306455 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:26.306471 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:26.306511 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:26.310402 (+ 3891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:26.311070 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:26.311079 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:26.311086 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:26.311283 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:26.311739 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:26.311742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:26.311744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:26.312378 (+ 634us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:26.312662 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:26.313041 (+ 379us) server_negotiation.cc:299] Negotiation successful
0806 04:45:26.313445 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":572,"thread_start_us":350,"threads_started":1}
I20260806 04:45:26.318526 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:45:26.322556 10659 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38049274a81a49419162201dba3a635c" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } }
I20260806 04:45:26.323050 10659 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:26.323170 10659 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38049274a81a49419162201dba3a635c, State: Initialized, Role: FOLLOWER
I20260806 04:45:26.323707 10659 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38049274a81a49419162201dba3a635c" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } }
I20260806 04:45:26.323967 10659 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:26.324098 10659 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:26.324316 10659 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:26.326403 10659 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38049274a81a49419162201dba3a635c" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } }
I20260806 04:45:26.326948 10659 leader_election.cc:302] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38049274a81a49419162201dba3a635c; no voters:
I20260806 04:45:26.327625 10659 leader_election.cc:288] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:26.327736 10665 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:26.330209 10659 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:26.334833 10665 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [term 1 LEADER]: Becoming Leader. State: Replica: 38049274a81a49419162201dba3a635c, State: Running, Role: LEADER
I20260806 04:45:26.335517 10665 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38049274a81a49419162201dba3a635c" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } }
I20260806 04:45:26.339156 10666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38049274a81a49419162201dba3a635c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38049274a81a49419162201dba3a635c" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } } }
I20260806 04:45:26.339594 10666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:26.340173 10667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38049274a81a49419162201dba3a635c. Latest consensus state: current_term: 1 leader_uuid: "38049274a81a49419162201dba3a635c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38049274a81a49419162201dba3a635c" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } } }
I20260806 04:45:26.340986 10667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:26.348197 10678 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:26.352234 10678 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:26.360229 10678 catalog_manager.cc:1347] Generated new cluster ID: a1744b4da769456e9657bc17359ff1c2
I20260806 04:45:26.360373 10678 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:26.374053 10662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:26.364558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49556 (local address 127.7.113.254:39897)
0806 04:45:26.364747 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:26.364757 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:26.365286 (+ 529us) server_negotiation.cc:407] Connection header received
0806 04:45:26.365459 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:26.365465 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:26.365551 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:26.365659 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:26.366797 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:26.368025 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:26.369775 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:26.370465 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:26.370602 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:26.371901 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:26.371909 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:26.371918 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:26.372940 (+ 1022us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:26.373051 (+ 111us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:26.373083 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:26.373195 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:26.373367 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 04:45:26.373466 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 04:45:26.374939 10678 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:26.376374 10678 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:26.382957 10678 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38049274a81a49419162201dba3a635c: Generated new TSK 0
I20260806 04:45:26.383723 10678 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:45:26.394622 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 10592
I20260806 04:45:26.395816 10654 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:26.483964 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 10592
2026-08-06T04:45:26Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1898 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:45:26 dist-test-slave-0b58 krb5kdc[10694](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:45:26 dist-test-slave-0b58 krb5kdc[10694](info): set up 2 sockets
Aug 06 04:45:26 dist-test-slave-0b58 krb5kdc[10694](info): commencing operation
krb5kdc: starting...
W20260806 04:45:27.590730 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.004s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:45:27 dist-test-slave-0b58 krb5kdc[10694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991527, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:45:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:45:27.795493 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:38207
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:33337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:38207
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:28.115021 10707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:28.115310 10707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:28.115489 10707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:28.122864 10707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:28.122959 10707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:28.123060 10707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:28.123164 10707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:28.123243 10707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:45:28.133010 10707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:33337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:38207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:38207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:28.134380 10707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:28.135665 10707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:28.147841 10712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:28.147816 10713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:28.147776 10715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:28.148658 10707 server_base.cc:1034] running on GCE node
I20260806 04:45:28.149410 10707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:28.150764 10707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:28.152007 10707 hybrid_clock.cc:648] HybridClock initialized: now 1785991528151968 us; error 59 us; skew 500 ppm
I20260806 04:45:28.152436 10707 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:28 dist-test-slave-0b58 krb5kdc[10694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991528, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:28.155417 10707 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:45:28.156859 10707 webserver.cc:460] Webserver started at http://127.7.113.254:45231/ using document root <none> and password file <none>
I20260806 04:45:28.157581 10707 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:28.157733 10707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:28.158031 10707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:28.160928 10707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "fbcb770b408343d1b92e2beb89142281"
format_stamp: "Formatted at 2026-08-06 04:45:28 on dist-test-slave-0b58"
server_key: "a0d3d30b64cbb31c694a5125bc5d43c9"
server_key_iv: "5e000d7468d06044f2f2035906758703"
server_key_version: "encryptionkey@0"
I20260806 04:45:28.161680 10707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "fbcb770b408343d1b92e2beb89142281"
format_stamp: "Formatted at 2026-08-06 04:45:28 on dist-test-slave-0b58"
server_key: "a0d3d30b64cbb31c694a5125bc5d43c9"
server_key_iv: "5e000d7468d06044f2f2035906758703"
server_key_version: "encryptionkey@0"
I20260806 04:45:28.166656 10707 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:45:28.169914 10722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:28.171201 10707 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 04:45:28.171386 10707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "fbcb770b408343d1b92e2beb89142281"
format_stamp: "Formatted at 2026-08-06 04:45:28 on dist-test-slave-0b58"
server_key: "a0d3d30b64cbb31c694a5125bc5d43c9"
server_key_iv: "5e000d7468d06044f2f2035906758703"
server_key_version: "encryptionkey@0"
I20260806 04:45:28.171576 10707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:28.185006 10707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:28.188723 10707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:28.189015 10707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:28.207422 10707 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:38207
I20260806 04:45:28.207461 10773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:38207 every 8 connection(s)
I20260806 04:45:28.208794 10707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:28.212391 10774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:28.214267 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 10707
I20260806 04:45:28.214522 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:28.215173 7623 external_mini_cluster.cc:1428] Setting key 8af9f9214ee1993643607b0f967769e3
I20260806 04:45:28.225693 10774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281: Bootstrap starting.
I20260806 04:45:28.229920 10774 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:28.231252 10774 log.cc:824] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281: Log is configured to *not* fsync() on all Append() calls
Aug 06 04:45:28 dist-test-slave-0b58 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991527, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:28.234673 10774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281: No bootstrap required, opened a new log
I20260806 04:45:28.241410 10777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:28.217196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44706 (local address 127.7.113.254:38207)
0806 04:45:28.218083 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:28.218097 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:28.218146 (+ 49us) server_negotiation.cc:407] Connection header received
0806 04:45:28.220536 (+ 2390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:28.220566 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:28.221034 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:28.221500 (+ 466us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:28.222909 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:28.224898 (+ 1989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:28.227065 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:28.228206 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:28.228467 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:28.233860 (+ 5393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:28.233872 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:28.233890 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:28.233935 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:28.237345 (+ 3410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:28.238075 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:28.238082 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:28.238088 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:28.238256 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:28.238649 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:28.238653 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:28.238672 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:28.239200 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:28.239537 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:28.239956 (+ 419us) server_negotiation.cc:299] Negotiation successful
0806 04:45:28.240411 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":367,"threads_started":1}
I20260806 04:45:28.242589 10774 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbcb770b408343d1b92e2beb89142281" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38207 } }
I20260806 04:45:28.243048 10774 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:28.243161 10774 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbcb770b408343d1b92e2beb89142281, State: Initialized, Role: FOLLOWER
I20260806 04:45:28.243782 10774 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbcb770b408343d1b92e2beb89142281" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38207 } }
I20260806 04:45:28.244108 10774 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:28.244346 10774 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:28.244539 10774 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:28.246651 10774 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbcb770b408343d1b92e2beb89142281" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38207 } }
I20260806 04:45:28.247077 10774 leader_election.cc:302] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbcb770b408343d1b92e2beb89142281; no voters:
I20260806 04:45:28.247617 10774 leader_election.cc:288] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:28.247730 10779 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:28.248560 10779 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [term 1 LEADER]: Becoming Leader. State: Replica: fbcb770b408343d1b92e2beb89142281, State: Running, Role: LEADER
I20260806 04:45:28.249120 10779 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbcb770b408343d1b92e2beb89142281" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38207 } }
I20260806 04:45:28.249990 10774 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:28.252044 10781 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbcb770b408343d1b92e2beb89142281. Latest consensus state: current_term: 1 leader_uuid: "fbcb770b408343d1b92e2beb89142281" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbcb770b408343d1b92e2beb89142281" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38207 } } }
I20260806 04:45:28.252486 10781 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:28.252072 10780 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbcb770b408343d1b92e2beb89142281" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbcb770b408343d1b92e2beb89142281" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38207 } } }
I20260806 04:45:28.252873 10780 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:28.256541 10784 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:28.267774 10784 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:28.276733 10784 catalog_manager.cc:1347] Generated new cluster ID: eee4c46a58504792a391143f2ba0fe38
I20260806 04:45:28.276856 10784 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:28.289381 10784 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:28.291268 10784 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:28.298575 10784 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbcb770b408343d1b92e2beb89142281: Generated new TSK 0
I20260806 04:45:28.299527 10784 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:45:28.351701 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38207
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:33337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:28.674508 10800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:28.674842 10800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:28.675019 10800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:28.682385 10800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:28.682550 10800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:28.682723 10800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:45:28.692075 10800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:33337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38207
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:28.693326 10800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:28.694615 10800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:28.707531 10809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:28.707511 10806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:28.708066 10805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:28.708194 10800 server_base.cc:1034] running on GCE node
I20260806 04:45:28.708812 10800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:28.709744 10800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:28.710974 10800 hybrid_clock.cc:648] HybridClock initialized: now 1785991528710928 us; error 57 us; skew 500 ppm
I20260806 04:45:28.711279 10800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:28 dist-test-slave-0b58 krb5kdc[10694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991528, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:28.714258 10800 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:45:28.715588 10800 webserver.cc:460] Webserver started at http://127.7.113.193:33899/ using document root <none> and password file <none>
I20260806 04:45:28.716238 10800 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:28.716430 10800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:28.716734 10800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:28.719524 10800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "e50ad4163cb145fea6feae451c9961cb"
format_stamp: "Formatted at 2026-08-06 04:45:28 on dist-test-slave-0b58"
server_key: "ba917dbd71572606871f77a6223577fb"
server_key_iv: "519bef28a23bdc5b861dcc4494fb954f"
server_key_version: "encryptionkey@0"
I20260806 04:45:28.720289 10800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "e50ad4163cb145fea6feae451c9961cb"
format_stamp: "Formatted at 2026-08-06 04:45:28 on dist-test-slave-0b58"
server_key: "ba917dbd71572606871f77a6223577fb"
server_key_iv: "519bef28a23bdc5b861dcc4494fb954f"
server_key_version: "encryptionkey@0"
I20260806 04:45:28.725242 10800 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260806 04:45:28.728700 10816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:28.729913 10800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 04:45:28.730082 10800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "e50ad4163cb145fea6feae451c9961cb"
format_stamp: "Formatted at 2026-08-06 04:45:28 on dist-test-slave-0b58"
server_key: "ba917dbd71572606871f77a6223577fb"
server_key_iv: "519bef28a23bdc5b861dcc4494fb954f"
server_key_version: "encryptionkey@0"
I20260806 04:45:28.730298 10800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:28.757184 10800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:28.761354 10800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:28.761655 10800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:28.762630 10800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:28.763895 10800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:28.763994 10800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:28.764140 10800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:28.764211 10800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:28.797062 10800 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:34777
I20260806 04:45:28.797113 10928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:34777 every 8 connection(s)
I20260806 04:45:28.798422 10800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:45:28.802551 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 10800
I20260806 04:45:28.802784 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:45:28.803398 7623 external_mini_cluster.cc:1428] Setting key 90bb57975b7d0c2cad355d8c081f5dd1
Aug 06 04:45:28 dist-test-slave-0b58 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991528, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:28.819170 10931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:28.800996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:42671 (local address 127.7.113.254:38207)
0806 04:45:28.801501 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:28.801505 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:28.802294 (+ 789us) server_negotiation.cc:407] Connection header received
0806 04:45:28.804230 (+ 1936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:28.804234 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:28.804369 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:28.804508 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:28.806043 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:28.807298 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:28.808903 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:28.809600 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:28.809753 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:28.813174 (+ 3421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:28.813184 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:28.813190 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:28.813236 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:28.815887 (+ 2651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:28.816864 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:28.816868 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:28.816870 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:28.816988 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:28.817474 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:28.817477 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:28.817479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:28.817726 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:28.817829 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:28.818760 (+ 931us) server_negotiation.cc:299] Negotiation successful
0806 04:45:28.818916 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":246,"threads_started":1}
I20260806 04:45:28.820701 10932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:28.801427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38207 (local address 127.7.113.193:42671)
0806 04:45:28.802146 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:28.802189 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:28.803945 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:28.804698 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:28.804705 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:28.805308 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:28.805854 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:28.805872 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:28.807454 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:28.807457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:28.808751 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:28.808763 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:28.809806 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:28.809811 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:28.810001 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:28.810672 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:28.810693 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:28.812953 (+ 2260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:28.816029 (+ 3076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:28.816040 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:28.816058 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:28.816746 (+ 688us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:28.817109 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:28.817116 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:28.817122 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:28.817365 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:28.817867 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:28.817877 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:28.818350 (+ 473us) client_negotiation.cc:769] Sending connection context
0806 04:45:28.818672 (+ 322us) client_negotiation.cc:240] Negotiation successful
0806 04:45:28.819222 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":279,"threads_started":1}
I20260806 04:45:28.822227 10929 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38207
I20260806 04:45:28.822574 10929 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:28.823473 10929 heartbeater.cc:511] Master 127.7.113.254:38207 requested a full tablet report, sending...
I20260806 04:45:28.825639 10739 ts_manager.cc:194] Registered new tserver with Master: e50ad4163cb145fea6feae451c9961cb (127.7.113.193:34777)
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
I20260806 04:45:28.827142 10739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:42671
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:45:28.852998 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38207
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:33337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:29.168715 10935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:29.169000 10935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:29.169190 10935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:29.176831 10935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:29.176973 10935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:29.177151 10935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:45:29.186683 10935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:33337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38207
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:29.187901 10935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:29.189190 10935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:29.202082 10940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:29.202116 10941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:29.202165 10943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:29.202960 10935 server_base.cc:1034] running on GCE node
I20260806 04:45:29.203605 10935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:29.204555 10935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:29.205760 10935 hybrid_clock.cc:648] HybridClock initialized: now 1785991529205711 us; error 45 us; skew 500 ppm
I20260806 04:45:29.206063 10935 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:29 dist-test-slave-0b58 krb5kdc[10694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991529, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:29.209259 10935 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:45:29.210685 10935 webserver.cc:460] Webserver started at http://127.7.113.194:37459/ using document root <none> and password file <none>
I20260806 04:45:29.211333 10935 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:29.211462 10935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:29.211776 10935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:29.214560 10935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "d4283de9934848748dd156d02ddbdd6e"
format_stamp: "Formatted at 2026-08-06 04:45:29 on dist-test-slave-0b58"
server_key: "7b7134d0f1c7b8f55f84ba20b87ca3b2"
server_key_iv: "92aa32fff1cbd04a588b7b22a6aca727"
server_key_version: "encryptionkey@0"
I20260806 04:45:29.215324 10935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "d4283de9934848748dd156d02ddbdd6e"
format_stamp: "Formatted at 2026-08-06 04:45:29 on dist-test-slave-0b58"
server_key: "7b7134d0f1c7b8f55f84ba20b87ca3b2"
server_key_iv: "92aa32fff1cbd04a588b7b22a6aca727"
server_key_version: "encryptionkey@0"
I20260806 04:45:29.220206 10935 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 04:45:29.223654 10950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:29.225064 10935 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:45:29.225238 10935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "d4283de9934848748dd156d02ddbdd6e"
format_stamp: "Formatted at 2026-08-06 04:45:29 on dist-test-slave-0b58"
server_key: "7b7134d0f1c7b8f55f84ba20b87ca3b2"
server_key_iv: "92aa32fff1cbd04a588b7b22a6aca727"
server_key_version: "encryptionkey@0"
I20260806 04:45:29.225435 10935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:29.251622 10935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:29.255712 10935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:29.256016 10935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:29.256997 10935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:29.258458 10935 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:29.258527 10935 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:29.258662 10935 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:29.258721 10935 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:29.291605 10935 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:37915
I20260806 04:45:29.291651 11063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:37915 every 8 connection(s)
I20260806 04:45:29.292840 10935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:45:29.302858 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 10935
I20260806 04:45:29.303105 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:45:29.303730 7623 external_mini_cluster.cc:1428] Setting key 515b1efadbed92df75ae900a92568998
Aug 06 04:45:29 dist-test-slave-0b58 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991529, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:29.312143 10931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:29.295265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:53837 (local address 127.7.113.254:38207)
0806 04:45:29.295432 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:29.295436 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:29.296601 (+ 1165us) server_negotiation.cc:407] Connection header received
0806 04:45:29.298299 (+ 1698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:29.298304 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:29.298378 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:29.298467 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:29.299772 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.300556 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.301999 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.302391 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.302481 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:29.306641 (+ 4160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:29.306646 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:29.306649 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:29.306679 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:29.309222 (+ 2543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:29.309913 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:29.309920 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:29.309929 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:29.310059 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:29.310488 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:29.310496 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:29.310500 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:29.310770 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:29.310931 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:29.311563 (+ 632us) server_negotiation.cc:299] Negotiation successful
0806 04:45:29.311793 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 04:45:29.313081 11066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:29.295683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38207 (local address 127.7.113.194:53837)
0806 04:45:29.296445 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:29.296482 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:29.298067 (+ 1585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:29.298648 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:29.298655 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:29.299123 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:29.299622 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:29.299638 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.300687 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.300691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:29.301874 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:29.301891 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.302640 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.302649 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:29.302951 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:29.303688 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:29.303717 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:29.306419 (+ 2702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:29.309362 (+ 2943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:29.309370 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:29.309384 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:29.309783 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:29.310175 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:29.310179 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:29.310183 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:29.310372 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:29.310901 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:29.310909 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:29.311216 (+ 307us) client_negotiation.cc:769] Sending connection context
0806 04:45:29.311483 (+ 267us) client_negotiation.cc:240] Negotiation successful
0806 04:45:29.311971 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":269,"threads_started":1}
I20260806 04:45:29.314502 11064 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38207
I20260806 04:45:29.314788 11064 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:29.315465 11064 heartbeater.cc:511] Master 127.7.113.254:38207 requested a full tablet report, sending...
I20260806 04:45:29.316882 10739 ts_manager.cc:194] Registered new tserver with Master: d4283de9934848748dd156d02ddbdd6e (127.7.113.194:37915)
I20260806 04:45:29.317662 10739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:53837
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:45:29.351084 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38207
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:33337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:29.665273 11069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:29.665534 11069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:29.665709 11069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:29.672830 11069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:29.672960 11069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:29.673146 11069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:45:29.682591 11069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:33337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38207
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:29.683838 11069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:29.685155 11069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:29.697618 11074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:29.697752 11075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:29.697772 11077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:29.698745 11069 server_base.cc:1034] running on GCE node
I20260806 04:45:29.699399 11069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:29.700359 11069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:29.701577 11069 hybrid_clock.cc:648] HybridClock initialized: now 1785991529701551 us; error 99 us; skew 500 ppm
I20260806 04:45:29.701876 11069 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:29 dist-test-slave-0b58 krb5kdc[10694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991529, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:29.705015 11069 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:45:29.706401 11069 webserver.cc:460] Webserver started at http://127.7.113.195:33555/ using document root <none> and password file <none>
I20260806 04:45:29.707002 11069 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:29.707099 11069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:29.707348 11069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:29.710306 11069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "0abfbae028b046ebaf9ea1e97e80a0fd"
format_stamp: "Formatted at 2026-08-06 04:45:29 on dist-test-slave-0b58"
server_key: "5b6c6d616f4472aed36c34fd91c84eac"
server_key_iv: "acec9a9afac0c79450ba0f1f34da25c0"
server_key_version: "encryptionkey@0"
I20260806 04:45:29.711004 11069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "0abfbae028b046ebaf9ea1e97e80a0fd"
format_stamp: "Formatted at 2026-08-06 04:45:29 on dist-test-slave-0b58"
server_key: "5b6c6d616f4472aed36c34fd91c84eac"
server_key_iv: "acec9a9afac0c79450ba0f1f34da25c0"
server_key_version: "encryptionkey@0"
I20260806 04:45:29.715772 11069 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.006s
I20260806 04:45:29.719065 11084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:29.720363 11069 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:45:29.720490 11069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "0abfbae028b046ebaf9ea1e97e80a0fd"
format_stamp: "Formatted at 2026-08-06 04:45:29 on dist-test-slave-0b58"
server_key: "5b6c6d616f4472aed36c34fd91c84eac"
server_key_iv: "acec9a9afac0c79450ba0f1f34da25c0"
server_key_version: "encryptionkey@0"
I20260806 04:45:29.720641 11069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:29.749274 11069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:29.753274 11069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:29.753528 11069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:29.754397 11069 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:29.755646 11069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:29.755718 11069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:29.755805 11069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:29.755856 11069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:29.788863 11069 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:35043
I20260806 04:45:29.788946 11196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:35043 every 8 connection(s)
I20260806 04:45:29.790125 11069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:45:29.799171 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 11069
I20260806 04:45:29.799372 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:45:29.799975 7623 external_mini_cluster.cc:1428] Setting key 7146474b456e5884f9461ed7bbe26486
Aug 06 04:45:29 dist-test-slave-0b58 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991529, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:29.809183 10931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:29.792500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:54811 (local address 127.7.113.254:38207)
0806 04:45:29.792719 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:29.792726 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:29.793909 (+ 1183us) server_negotiation.cc:407] Connection header received
0806 04:45:29.795634 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:29.795639 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:29.795732 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:29.795826 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:29.797264 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.797994 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.800008 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.800670 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.800791 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:29.804354 (+ 3563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:29.804359 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:29.804362 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:29.804394 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:29.806702 (+ 2308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:29.807309 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:29.807312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:29.807314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:29.807444 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:29.807797 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:29.807800 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:29.807802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:29.808047 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:29.808159 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:29.808793 (+ 634us) server_negotiation.cc:299] Negotiation successful
0806 04:45:29.808945 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 04:45:29.810014 11199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:29.793100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38207 (local address 127.7.113.195:54811)
0806 04:45:29.793754 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:29.793791 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:29.795405 (+ 1614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:29.796020 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:29.796027 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:29.796591 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:29.797094 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:29.797110 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.798158 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.798162 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:29.799840 (+ 1678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:29.799854 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.801079 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.801086 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:29.801368 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:29.802040 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:29.802061 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:29.804106 (+ 2045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:29.806828 (+ 2722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:29.806834 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:29.806844 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:29.807212 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:29.807537 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:29.807540 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:29.807542 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:29.807707 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:29.808164 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:29.808169 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:29.808497 (+ 328us) client_negotiation.cc:769] Sending connection context
0806 04:45:29.808702 (+ 205us) client_negotiation.cc:240] Negotiation successful
0806 04:45:29.809031 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":270,"threads_started":1}
I20260806 04:45:29.811326 11197 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38207
I20260806 04:45:29.811631 11197 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:29.812376 11197 heartbeater.cc:511] Master 127.7.113.254:38207 requested a full tablet report, sending...
I20260806 04:45:29.813737 10739 ts_manager.cc:194] Registered new tserver with Master: 0abfbae028b046ebaf9ea1e97e80a0fd (127.7.113.195:35043)
I20260806 04:45:29.814647 10739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:54811
I20260806 04:45:29.815095 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:45:29.830102 10929 heartbeater.cc:503] Master 127.7.113.254:38207 was elected leader, sending a full tablet report...
Aug 06 04:45:29 dist-test-slave-0b58 krb5kdc[10694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991529, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 06 04:45:29 dist-test-slave-0b58 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991529, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:29.869390 10931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:29.855487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44718 (local address 127.7.113.254:38207)
0806 04:45:29.855665 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:29.855670 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:29.856193 (+ 523us) server_negotiation.cc:407] Connection header received
0806 04:45:29.856414 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:29.856418 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:29.856483 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:29.856571 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:29.858012 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.858823 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.859991 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.860430 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.860525 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:29.864352 (+ 3827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:29.864358 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:29.864361 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:29.864393 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:29.866704 (+ 2311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:29.867355 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:29.867362 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:29.867365 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:29.867503 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:29.867916 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:29.867921 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:29.867927 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:29.868244 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:29.868548 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:29.868842 (+ 294us) server_negotiation.cc:299] Negotiation successful
0806 04:45:29.869059 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260806 04:45:29.869930 10739 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:44718
I20260806 04:45:29.871307 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 10800
Aug 06 04:45:29 dist-test-slave-0b58 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991529, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:45:29.886513 11208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:29.872506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52028 (local address 127.7.113.193:34777)
0806 04:45:29.873119 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:29.873126 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:29.873150 (+ 24us) server_negotiation.cc:407] Connection header received
0806 04:45:29.873210 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:29.873216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:29.873419 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:29.873555 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:29.874594 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.875650 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.876912 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.877458 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.877556 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:29.881302 (+ 3746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:29.881313 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:29.881325 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:29.881356 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:29.884113 (+ 2757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:29.884763 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:29.884770 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:29.884772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:29.884899 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:29.885210 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:29.885213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:29.885214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:29.885614 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:29.885832 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:29.886035 (+ 203us) server_negotiation.cc:299] Negotiation successful
0806 04:45:29.886234 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":323,"threads_started":1}
W20260806 04:45:29.887732 10924 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52028
W20260806 04:45:29.888854 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 10800: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:45:29.889016 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 10800
I20260806 04:45:29.906834 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 10935
Aug 06 04:45:29 dist-test-slave-0b58 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991529, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:45:29.921573 11209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:29.907666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51618 (local address 127.7.113.194:37915)
0806 04:45:29.908214 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:29.908220 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:29.908244 (+ 24us) server_negotiation.cc:407] Connection header received
0806 04:45:29.908361 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:29.908368 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:29.908563 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:29.908683 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:29.909803 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.910770 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.911919 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.912496 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.912596 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:29.916423 (+ 3827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:29.916433 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:29.916445 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:29.916495 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:29.919202 (+ 2707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:29.919744 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:29.919750 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:29.919752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:29.919870 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:29.920173 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:29.920176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:29.920178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:29.920605 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:29.920892 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:29.921026 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 04:45:29.921201 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":277,"threads_started":1}
W20260806 04:45:29.922716 11058 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:51618
W20260806 04:45:29.923699 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 10935: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:45:29.923878 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 10935
I20260806 04:45:29.940589 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 11069
Aug 06 04:45:29 dist-test-slave-0b58 krb5kdc[10694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991529, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:45:29.955826 11210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:29.941474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48162 (local address 127.7.113.195:35043)
0806 04:45:29.942033 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:29.942039 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:29.942066 (+ 27us) server_negotiation.cc:407] Connection header received
0806 04:45:29.942119 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:29.942125 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:29.942305 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:29.942476 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:29.943795 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.944888 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.946063 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:29.946617 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:29.946754 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:29.950999 (+ 4245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:29.951009 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:29.951022 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:29.951064 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:29.953647 (+ 2583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:29.954205 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:29.954211 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:29.954213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:29.954328 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:29.954635 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:29.954638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:29.954640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:29.954961 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:29.955188 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:29.955380 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 04:45:29.955559 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":285,"threads_started":1}
W20260806 04:45:29.957140 11192 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:48162
W20260806 04:45:29.958177 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 11069: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:45:29.958317 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 11069
I20260806 04:45:29.976240 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 10707
I20260806 04:45:29.977330 10769 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:30.079638 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 10707
2026-08-06T04:45:30Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3601 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:45:30 dist-test-slave-0b58 krb5kdc[11214](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:45:30 dist-test-slave-0b58 krb5kdc[11214](info): set up 2 sockets
Aug 06 04:45:30 dist-test-slave-0b58 krb5kdc[11214](info): commencing operation
krb5kdc: starting...
W20260806 04:45:31.182965 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:45:31 dist-test-slave-0b58 krb5kdc[11214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991531, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:45:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:45:31.389679 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:40459
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:34701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:40459
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:31.707482 11227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:31.707762 11227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:31.707855 11227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:31.715216 11227 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:31.715322 11227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:31.715375 11227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:31.715431 11227 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:31.715474 11227 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:45:31.725327 11227 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:34701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:40459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:40459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:31.726639 11227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:31.727891 11227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:31.739826 11232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:31.739867 11235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:31.739912 11233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:31.740648 11227 server_base.cc:1034] running on GCE node
I20260806 04:45:31.741453 11227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:31.742780 11227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:31.744010 11227 hybrid_clock.cc:648] HybridClock initialized: now 1785991531743969 us; error 35 us; skew 500 ppm
I20260806 04:45:31.744405 11227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:31 dist-test-slave-0b58 krb5kdc[11214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991531, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:31.747386 11227 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:45:31.748780 11227 webserver.cc:460] Webserver started at http://127.7.113.254:41659/ using document root <none> and password file <none>
I20260806 04:45:31.749400 11227 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:31.749500 11227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:31.749758 11227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:31.752636 11227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "ac3f10eac21749beb021a90eb0c70083"
format_stamp: "Formatted at 2026-08-06 04:45:31 on dist-test-slave-0b58"
server_key: "040ffcbe235fd3c501332f56e5020f33"
server_key_iv: "8c46dd1a7ddffda59f9d145dd210ba4b"
server_key_version: "encryptionkey@0"
I20260806 04:45:31.753350 11227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "ac3f10eac21749beb021a90eb0c70083"
format_stamp: "Formatted at 2026-08-06 04:45:31 on dist-test-slave-0b58"
server_key: "040ffcbe235fd3c501332f56e5020f33"
server_key_iv: "8c46dd1a7ddffda59f9d145dd210ba4b"
server_key_version: "encryptionkey@0"
I20260806 04:45:31.758312 11227 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:45:31.761502 11242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:31.762714 11227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:45:31.762888 11227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "ac3f10eac21749beb021a90eb0c70083"
format_stamp: "Formatted at 2026-08-06 04:45:31 on dist-test-slave-0b58"
server_key: "040ffcbe235fd3c501332f56e5020f33"
server_key_iv: "8c46dd1a7ddffda59f9d145dd210ba4b"
server_key_version: "encryptionkey@0"
I20260806 04:45:31.763070 11227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:31.780840 11227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:31.785025 11227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:31.785328 11227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:31.803637 11227 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:40459
I20260806 04:45:31.803673 11293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:40459 every 8 connection(s)
I20260806 04:45:31.805025 11227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:31.805590 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 11227
I20260806 04:45:31.805811 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:31.806643 7623 external_mini_cluster.cc:1428] Setting key 2e25d6940975f9ef2b19057ccf282519
I20260806 04:45:31.809325 11294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 04:45:31 dist-test-slave-0b58 krb5kdc[11214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991531, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:31.822201 11294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083: Bootstrap starting.
I20260806 04:45:31.825326 11294 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:31.826359 11294 log.cc:824] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:31.829399 11297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:31.808661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44202 (local address 127.7.113.254:40459)
0806 04:45:31.809499 (+ 838us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:31.809511 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:31.809548 (+ 37us) server_negotiation.cc:407] Connection header received
0806 04:45:31.811157 (+ 1609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:31.811177 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:31.811533 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:31.811856 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:31.813689 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:31.815021 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:31.816832 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:31.817454 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:31.817585 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:31.822145 (+ 4560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:31.822152 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:31.822165 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:31.822206 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:31.825209 (+ 3003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:31.825935 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:31.825942 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:31.825947 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:31.826112 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:31.826551 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:31.826562 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:31.826565 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:31.827032 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:31.827380 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:31.827781 (+ 401us) server_negotiation.cc:299] Negotiation successful
0806 04:45:31.828200 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":590,"thread_start_us":365,"threads_started":1}
I20260806 04:45:31.829510 11294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083: No bootstrap required, opened a new log
I20260806 04:45:31.837260 11294 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3f10eac21749beb021a90eb0c70083" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 40459 } }
I20260806 04:45:31.837613 11294 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:31.837723 11294 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3f10eac21749beb021a90eb0c70083, State: Initialized, Role: FOLLOWER
I20260806 04:45:31.838238 11294 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3f10eac21749beb021a90eb0c70083" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 40459 } }
I20260806 04:45:31.838495 11294 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:31.838640 11294 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:31.838809 11294 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:31.841035 11294 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3f10eac21749beb021a90eb0c70083" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 40459 } }
I20260806 04:45:31.841457 11294 leader_election.cc:302] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac3f10eac21749beb021a90eb0c70083; no voters:
I20260806 04:45:31.841945 11294 leader_election.cc:288] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:31.842067 11299 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:31.843127 11299 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [term 1 LEADER]: Becoming Leader. State: Replica: ac3f10eac21749beb021a90eb0c70083, State: Running, Role: LEADER
I20260806 04:45:31.843683 11299 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3f10eac21749beb021a90eb0c70083" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 40459 } }
I20260806 04:45:31.844108 11294 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:31.846657 11301 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac3f10eac21749beb021a90eb0c70083. Latest consensus state: current_term: 1 leader_uuid: "ac3f10eac21749beb021a90eb0c70083" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3f10eac21749beb021a90eb0c70083" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 40459 } } }
I20260806 04:45:31.847172 11301 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:31.846628 11300 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac3f10eac21749beb021a90eb0c70083" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3f10eac21749beb021a90eb0c70083" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 40459 } } }
I20260806 04:45:31.847708 11300 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:31.849884 11307 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:31.854796 11307 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:31.863431 11307 catalog_manager.cc:1347] Generated new cluster ID: 7947ca5114cc4f0382f0c441d6a044ce
I20260806 04:45:31.863554 11307 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:31.893501 11307 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:31.894819 11307 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:31.914562 11307 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac3f10eac21749beb021a90eb0c70083: Generated new TSK 0
I20260806 04:45:31.915387 11307 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:45:31.983322 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:40459
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:34701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:32.309284 11320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:32.309551 11320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:32.309667 11320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:32.316684 11320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:32.316802 11320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:32.316979 11320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:45:32.326468 11320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:34701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:40459
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:32.327657 11320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:32.328991 11320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:32.341439 11325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:32.341512 11326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:32.341559 11328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:32.342309 11320 server_base.cc:1034] running on GCE node
I20260806 04:45:32.342891 11320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:32.343768 11320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:32.344955 11320 hybrid_clock.cc:648] HybridClock initialized: now 1785991532344909 us; error 41 us; skew 500 ppm
I20260806 04:45:32.345299 11320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:32 dist-test-slave-0b58 krb5kdc[11214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991532, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:32.348498 11320 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:45:32.349907 11320 webserver.cc:460] Webserver started at http://127.7.113.193:36193/ using document root <none> and password file <none>
I20260806 04:45:32.350577 11320 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:32.350709 11320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:32.351044 11320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:32.353816 11320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "cc84896e96c14f1a8efe74727060e15f"
format_stamp: "Formatted at 2026-08-06 04:45:32 on dist-test-slave-0b58"
server_key: "34be52977a7698c97ff52f900db3d0e1"
server_key_iv: "398306a030c7b4a0c101cb522d217acb"
server_key_version: "encryptionkey@0"
I20260806 04:45:32.354565 11320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "cc84896e96c14f1a8efe74727060e15f"
format_stamp: "Formatted at 2026-08-06 04:45:32 on dist-test-slave-0b58"
server_key: "34be52977a7698c97ff52f900db3d0e1"
server_key_iv: "398306a030c7b4a0c101cb522d217acb"
server_key_version: "encryptionkey@0"
I20260806 04:45:32.359397 11320 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 04:45:32.362754 11335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:32.363950 11320 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:45:32.364118 11320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "cc84896e96c14f1a8efe74727060e15f"
format_stamp: "Formatted at 2026-08-06 04:45:32 on dist-test-slave-0b58"
server_key: "34be52977a7698c97ff52f900db3d0e1"
server_key_iv: "398306a030c7b4a0c101cb522d217acb"
server_key_version: "encryptionkey@0"
I20260806 04:45:32.364374 11320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:32.384954 11320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:32.389093 11320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:32.389374 11320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:32.390373 11320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:32.391594 11320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:32.391667 11320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:32.391830 11320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:32.391889 11320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:32.424007 11320 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:38083
I20260806 04:45:32.424094 11447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:38083 every 8 connection(s)
I20260806 04:45:32.425294 11320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:45:32.435461 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 11320
I20260806 04:45:32.435673 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:45:32.436547 7623 external_mini_cluster.cc:1428] Setting key 1e9478bd505cb2e355df05ba2799facb
Aug 06 04:45:32 dist-test-slave-0b58 krb5kdc[11214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991532, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:32.446306 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:32.427711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:53097 (local address 127.7.113.254:40459)
0806 04:45:32.428132 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:32.428136 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:32.429161 (+ 1025us) server_negotiation.cc:407] Connection header received
0806 04:45:32.430970 (+ 1809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:32.430974 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:32.431044 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:32.431139 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:32.432570 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:32.433269 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:32.434707 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:32.435107 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:32.435203 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:32.439321 (+ 4118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:32.439327 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:32.439331 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:32.439368 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:32.443021 (+ 3653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:32.443689 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:32.443697 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:32.443703 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:32.443864 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:32.444303 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:32.444311 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:32.444317 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:32.444732 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:32.444895 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:32.445560 (+ 665us) server_negotiation.cc:299] Negotiation successful
0806 04:45:32.445829 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":208,"threads_started":1}
I20260806 04:45:32.446955 11451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:32.428333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:40459 (local address 127.7.113.193:53097)
0806 04:45:32.429011 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:32.429047 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:32.430732 (+ 1685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:32.431346 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:32.431353 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:32.431826 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:32.432423 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:32.432442 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:32.433407 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:32.433410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:32.434585 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:32.434596 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:32.435348 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:32.435357 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:32.435655 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:32.436397 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:32.436434 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:32.439101 (+ 2667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:32.443151 (+ 4050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:32.443158 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:32.443168 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:32.443558 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:32.443971 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:32.443974 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:32.443976 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:32.444142 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:32.444881 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:32.444887 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:32.445181 (+ 294us) client_negotiation.cc:769] Sending connection context
0806 04:45:32.445436 (+ 255us) client_negotiation.cc:240] Negotiation successful
0806 04:45:32.445872 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":263,"threads_started":1}
I20260806 04:45:32.448591 11448 heartbeater.cc:347] Connected to a master server at 127.7.113.254:40459
I20260806 04:45:32.448915 11448 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:32.449668 11448 heartbeater.cc:511] Master 127.7.113.254:40459 requested a full tablet report, sending...
I20260806 04:45:32.452052 11259 ts_manager.cc:194] Registered new tserver with Master: cc84896e96c14f1a8efe74727060e15f (127.7.113.193:38083)
I20260806 04:45:32.454243 11259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:53097
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:45:32.488060 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:40459
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:34701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:32.906325 11454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:32.906795 11454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:32.906929 11454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:32.921862 11454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:32.922021 11454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:32.922238 11454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:45:32.939595 11454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:34701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:40459
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:32.941785 11454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:32.943985 11454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:32.969660 11460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:32.970935 11461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:32.973039 11463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:32.973757 11454 server_base.cc:1034] running on GCE node
I20260806 04:45:32.974784 11454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:32.976450 11454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:32.977771 11454 hybrid_clock.cc:648] HybridClock initialized: now 1785991532977668 us; error 100 us; skew 500 ppm
I20260806 04:45:32.978318 11454 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:32 dist-test-slave-0b58 krb5kdc[11214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991532, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:32.983948 11454 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:45:32.987164 11454 webserver.cc:460] Webserver started at http://127.7.113.194:37141/ using document root <none> and password file <none>
I20260806 04:45:32.988498 11454 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:32.988783 11454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:32.989339 11454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:32.994848 11454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "1b774392b108469c923814dc3bb5fe80"
format_stamp: "Formatted at 2026-08-06 04:45:32 on dist-test-slave-0b58"
server_key: "98ad1e658d6a74491d15f170381ca8a0"
server_key_iv: "2a56b513838a7b0c3555925f1b021d3f"
server_key_version: "encryptionkey@0"
I20260806 04:45:32.996501 11454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "1b774392b108469c923814dc3bb5fe80"
format_stamp: "Formatted at 2026-08-06 04:45:32 on dist-test-slave-0b58"
server_key: "98ad1e658d6a74491d15f170381ca8a0"
server_key_iv: "2a56b513838a7b0c3555925f1b021d3f"
server_key_version: "encryptionkey@0"
I20260806 04:45:33.006789 11454 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.001s sys 0.007s
I20260806 04:45:33.013206 11470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:33.015862 11454 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.001s
I20260806 04:45:33.016135 11454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "1b774392b108469c923814dc3bb5fe80"
format_stamp: "Formatted at 2026-08-06 04:45:32 on dist-test-slave-0b58"
server_key: "98ad1e658d6a74491d15f170381ca8a0"
server_key_iv: "2a56b513838a7b0c3555925f1b021d3f"
server_key_version: "encryptionkey@0"
I20260806 04:45:33.016669 11454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:33.073259 11454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:33.077349 11454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:33.077584 11454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:33.078464 11454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:33.079694 11454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:33.079766 11454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:33.079854 11454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:33.079896 11454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:33.112839 11454 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:44027
I20260806 04:45:33.112931 11583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:44027 every 8 connection(s)
I20260806 04:45:33.114125 11454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:45:33.114650 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 11454
I20260806 04:45:33.114850 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:45:33.115440 7623 external_mini_cluster.cc:1428] Setting key b287344fa7405e63373fdb5a1236828a
Aug 06 04:45:33 dist-test-slave-0b58 krb5kdc[11214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991532, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:33.136989 11586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:33.116953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:33673 (local address 127.7.113.254:40459)
0806 04:45:33.117500 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:33.117507 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:33.118626 (+ 1119us) server_negotiation.cc:407] Connection header received
0806 04:45:33.120480 (+ 1854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:33.120487 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:33.120574 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:33.120693 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:33.122129 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.122840 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.124806 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.125484 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.125623 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:33.129580 (+ 3957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:33.129589 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:33.129597 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:33.129642 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:33.133390 (+ 3748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:33.134116 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:33.134124 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:33.134130 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:33.134303 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:33.134917 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:33.134926 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:33.134932 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:33.135328 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:33.135489 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:33.136193 (+ 704us) server_negotiation.cc:299] Negotiation successful
0806 04:45:33.136473 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":274,"threads_started":1}
I20260806 04:45:33.138309 11587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:33.117654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:40459 (local address 127.7.113.194:33673)
0806 04:45:33.118454 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:33.118506 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:33.120165 (+ 1659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:33.120887 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:33.120894 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:33.121410 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:33.121957 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:33.121973 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.122984 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.122989 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:33.124651 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:33.124664 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.125718 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.125723 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:33.125929 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:33.126640 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:33.126679 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:33.129351 (+ 2672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:33.133533 (+ 4182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:33.133539 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:33.133551 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:33.133981 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:33.134589 (+ 608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:33.134592 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:33.134594 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:33.134782 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:33.135460 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:33.135466 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:33.135788 (+ 322us) client_negotiation.cc:769] Sending connection context
0806 04:45:33.136028 (+ 240us) client_negotiation.cc:240] Negotiation successful
0806 04:45:33.136486 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":339,"threads_started":1}
I20260806 04:45:33.139727 11584 heartbeater.cc:347] Connected to a master server at 127.7.113.254:40459
I20260806 04:45:33.140100 11584 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
I20260806 04:45:33.141008 11584 heartbeater.cc:511] Master 127.7.113.254:40459 requested a full tablet report, sending...
I20260806 04:45:33.142498 11259 ts_manager.cc:194] Registered new tserver with Master: 1b774392b108469c923814dc3bb5fe80 (127.7.113.194:44027)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
I20260806 04:45:33.143472 11259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:33673
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:45:33.169236 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:40459
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:34701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:45:33.457284 11448 heartbeater.cc:503] Master 127.7.113.254:40459 was elected leader, sending a full tablet report...
W20260806 04:45:33.493398 11590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:33.493748 11590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:33.493929 11590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:33.502054 11590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:33.502188 11590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:33.502372 11590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:45:33.511852 11590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:34701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:40459
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:33.513124 11590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:33.514406 11590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:33.527240 11596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:33.527357 11595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:33.527311 11598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:33.528139 11590 server_base.cc:1034] running on GCE node
I20260806 04:45:33.528731 11590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:33.529596 11590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:33.530818 11590 hybrid_clock.cc:648] HybridClock initialized: now 1785991533530783 us; error 46 us; skew 500 ppm
I20260806 04:45:33.531127 11590 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:33 dist-test-slave-0b58 krb5kdc[11214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991533, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:33.534078 11590 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:45:33.535465 11590 webserver.cc:460] Webserver started at http://127.7.113.195:41341/ using document root <none> and password file <none>
I20260806 04:45:33.536108 11590 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:33.536249 11590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:33.536599 11590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:33.539336 11590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "b515f7f53bf745b198529623e89528c0"
format_stamp: "Formatted at 2026-08-06 04:45:33 on dist-test-slave-0b58"
server_key: "81ed3f21c0e5fa9649eb055ac838029c"
server_key_iv: "5a6160a55e5f934bedf568a5a5e04f97"
server_key_version: "encryptionkey@0"
I20260806 04:45:33.540104 11590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "b515f7f53bf745b198529623e89528c0"
format_stamp: "Formatted at 2026-08-06 04:45:33 on dist-test-slave-0b58"
server_key: "81ed3f21c0e5fa9649eb055ac838029c"
server_key_iv: "5a6160a55e5f934bedf568a5a5e04f97"
server_key_version: "encryptionkey@0"
I20260806 04:45:33.545197 11590 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:45:33.548516 11605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:33.549808 11590 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:45:33.549962 11590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "b515f7f53bf745b198529623e89528c0"
format_stamp: "Formatted at 2026-08-06 04:45:33 on dist-test-slave-0b58"
server_key: "81ed3f21c0e5fa9649eb055ac838029c"
server_key_iv: "5a6160a55e5f934bedf568a5a5e04f97"
server_key_version: "encryptionkey@0"
I20260806 04:45:33.550136 11590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:33.564867 11590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:33.569054 11590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:33.569332 11590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:33.570267 11590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:33.571575 11590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:33.571648 11590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:33.571828 11590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:33.571880 11590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:33.604959 11590 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:36893
I20260806 04:45:33.605036 11718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:36893 every 8 connection(s)
I20260806 04:45:33.606259 11590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:45:33.609972 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 11590
I20260806 04:45:33.610153 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:45:33.610713 7623 external_mini_cluster.cc:1428] Setting key abc7150beacfd0bc63c12f70e21228b6
Aug 06 04:45:33 dist-test-slave-0b58 krb5kdc[11214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991533, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:33.626027 11586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:33.608786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:50031 (local address 127.7.113.254:40459)
0806 04:45:33.608971 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:33.608976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:33.610306 (+ 1330us) server_negotiation.cc:407] Connection header received
0806 04:45:33.612642 (+ 2336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:33.612648 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:33.612745 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:33.612830 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:33.614440 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.615165 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.616718 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.617109 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.617210 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:33.620302 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:33.620309 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:33.620316 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:33.620360 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:33.622899 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:33.623598 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:33.623601 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:33.623604 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:33.623722 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:33.624106 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:33.624109 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:33.624111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:33.624503 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:33.624639 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:33.625431 (+ 792us) server_negotiation.cc:299] Negotiation successful
0806 04:45:33.625646 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 04:45:33.627015 11721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:33.609251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:40459 (local address 127.7.113.195:50031)
0806 04:45:33.610115 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:33.610174 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:33.612339 (+ 2165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:33.613068 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:33.613076 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:33.613661 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:33.614291 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:33.614308 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.615307 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.615310 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:33.616599 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:33.616611 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.617295 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.617317 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:33.617505 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:33.618084 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:33.618105 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:33.620095 (+ 1990us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:33.623010 (+ 2915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:33.623016 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:33.623025 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:33.623503 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:33.623814 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:33.623817 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:33.623819 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:33.624002 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:33.624627 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:33.624636 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:33.625028 (+ 392us) client_negotiation.cc:769] Sending connection context
0806 04:45:33.625328 (+ 300us) client_negotiation.cc:240] Negotiation successful
0806 04:45:33.625762 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":318,"threads_started":1}
I20260806 04:45:33.628309 11719 heartbeater.cc:347] Connected to a master server at 127.7.113.254:40459
I20260806 04:45:33.628605 11719 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:33.629297 11719 heartbeater.cc:511] Master 127.7.113.254:40459 requested a full tablet report, sending...
I20260806 04:45:33.630643 11259 ts_manager.cc:194] Registered new tserver with Master: b515f7f53bf745b198529623e89528c0 (127.7.113.195:36893)
I20260806 04:45:33.631394 11259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:50031
I20260806 04:45:33.638096 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 04:45:33 dist-test-slave-0b58 krb5kdc[11214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 04:45:33 dist-test-slave-0b58 krb5kdc[11214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:45:33.690378 11726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:33.675590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52156 (local address 127.7.113.193:38083)
0806 04:45:33.676192 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:33.676199 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:33.676227 (+ 28us) server_negotiation.cc:407] Connection header received
0806 04:45:33.676369 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:33.676377 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:33.676593 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:33.676721 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:33.678027 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.679024 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.680200 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.680847 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.680941 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:33.684885 (+ 3944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:33.684896 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:33.684909 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:33.684937 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:33.687673 (+ 2736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:33.688317 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:33.688332 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:33.688334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:33.688451 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:33.688842 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:33.688846 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:33.688848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:33.689168 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:33.689472 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:33.689782 (+ 310us) server_negotiation.cc:299] Negotiation successful
0806 04:45:33.690036 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":313,"threads_started":1}
Aug 06 04:45:33 dist-test-slave-0b58 krb5kdc[11214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:33.707304 11586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:33.694715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44212 (local address 127.7.113.254:40459)
0806 04:45:33.694928 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:33.694933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:33.694951 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:45:33.695085 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:33.695089 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:33.695156 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:33.695232 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:33.696458 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.697172 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.698387 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.698782 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.698875 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:33.702407 (+ 3532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:33.702412 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:33.702415 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:33.702446 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:33.705084 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:33.705637 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:33.705640 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:33.705642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:33.705753 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:33.706059 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:33.706062 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:33.706064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:33.706352 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:33.706543 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:33.706796 (+ 253us) server_negotiation.cc:299] Negotiation successful
0806 04:45:33.706944 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260806 04:45:33.707868 11259 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44212
I20260806 04:45:33.708854 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 11320
I20260806 04:45:33.720410 11726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:33.709652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52170 (local address 127.7.113.193:38083)
0806 04:45:33.709810 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:33.709814 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:33.710138 (+ 324us) server_negotiation.cc:407] Connection header received
0806 04:45:33.710250 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:33.710254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:33.710340 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:33.710417 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:33.711495 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.712149 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.713328 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.713709 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.713809 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:33.715778 (+ 1969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:33.715788 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:33.715791 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:33.715818 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:33.718418 (+ 2600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:33.718951 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:33.718954 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:33.718957 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:33.719064 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:33.719360 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:33.719363 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:33.719365 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:33.719579 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:33.719740 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:33.719973 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 04:45:33.720125 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 04:45:33.721024 11443 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:33.803488 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 11320
I20260806 04:45:33.825263 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 11454
Aug 06 04:45:33 dist-test-slave-0b58 krb5kdc[11214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:45:33.845327 11731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:33.826227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53594 (local address 127.7.113.194:44027)
0806 04:45:33.826826 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:33.826833 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:33.826859 (+ 26us) server_negotiation.cc:407] Connection header received
0806 04:45:33.826919 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:33.826925 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:33.827131 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:33.827263 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:33.828431 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.829430 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.830639 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.831166 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.831257 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:33.839488 (+ 8231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:33.839498 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:33.839512 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:33.839548 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:33.842377 (+ 2829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:33.843058 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:33.843065 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:33.843067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:33.843189 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:33.843587 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:33.843593 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:33.843596 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:33.843939 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:33.844307 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:33.844638 (+ 331us) server_negotiation.cc:299] Negotiation successful
0806 04:45:33.844912 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":303,"threads_started":1}
I20260806 04:45:33.846566 11579 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:33.929006 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 11454
I20260806 04:45:33.947431 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 11590
Aug 06 04:45:33 dist-test-slave-0b58 krb5kdc[11214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:45:33.964003 11733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:33.948518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46552 (local address 127.7.113.195:36893)
0806 04:45:33.949139 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:33.949145 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:33.949174 (+ 29us) server_negotiation.cc:407] Connection header received
0806 04:45:33.949276 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:33.949283 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:33.949494 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:33.949719 (+ 225us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:33.951169 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.952192 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.953546 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:33.954175 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:33.954315 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:33.958462 (+ 4147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:33.958472 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:33.958486 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:33.958518 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:33.961218 (+ 2700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:33.961884 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:33.961891 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:33.961893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:33.962014 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:33.962388 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:33.962399 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:33.962401 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:33.962726 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:33.963072 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:33.963376 (+ 304us) server_negotiation.cc:299] Negotiation successful
0806 04:45:33.963649 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":328,"threads_started":1}
I20260806 04:45:33.965559 11714 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:34.048239 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 11590
I20260806 04:45:34.065716 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 11227
I20260806 04:45:34.067186 11289 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:34.170647 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 11227
2026-08-06T04:45:34Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4091 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:45:34 dist-test-slave-0b58 krb5kdc[11738](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:45:34 dist-test-slave-0b58 krb5kdc[11738](info): set up 2 sockets
Aug 06 04:45:34 dist-test-slave-0b58 krb5kdc[11738](info): commencing operation
krb5kdc: starting...
W20260806 04:45:35.274636 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.003s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:45:35 dist-test-slave-0b58 krb5kdc[11738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:45:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:45:35.480058 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:43393
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:43393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:35.800052 11751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:35.800422 11751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:35.800611 11751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:35.807691 11751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:35.807793 11751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:35.807910 11751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:35.808017 11751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:35.808106 11751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:45:35.818326 11751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:43393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:43393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:35.819573 11751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:35.820933 11751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:35.833141 11759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:35.833272 11756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:35.833278 11757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:35.834098 11751 server_base.cc:1034] running on GCE node
I20260806 04:45:35.834949 11751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:35.836387 11751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:35.837623 11751 hybrid_clock.cc:648] HybridClock initialized: now 1785991535837588 us; error 43 us; skew 500 ppm
I20260806 04:45:35.837970 11751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:35 dist-test-slave-0b58 krb5kdc[11738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991535, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:35.840971 11751 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:45:35.842193 11751 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:35.842335 11751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:35.842658 11751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:35.845679 11751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "f50784f229e141ffb3b5137750a6de52"
format_stamp: "Formatted at 2026-08-06 04:45:35 on dist-test-slave-0b58"
server_key: "01b127a8e76ceea431355172aaac2e72"
server_key_iv: "60570297cfbda16aa6b790767b449ea3"
server_key_version: "encryptionkey@0"
I20260806 04:45:35.846508 11751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "f50784f229e141ffb3b5137750a6de52"
format_stamp: "Formatted at 2026-08-06 04:45:35 on dist-test-slave-0b58"
server_key: "01b127a8e76ceea431355172aaac2e72"
server_key_iv: "60570297cfbda16aa6b790767b449ea3"
server_key_version: "encryptionkey@0"
I20260806 04:45:35.851423 11751 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260806 04:45:35.854763 11765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:35.856012 11751 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:45:35.856191 11751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "f50784f229e141ffb3b5137750a6de52"
format_stamp: "Formatted at 2026-08-06 04:45:35 on dist-test-slave-0b58"
server_key: "01b127a8e76ceea431355172aaac2e72"
server_key_iv: "60570297cfbda16aa6b790767b449ea3"
server_key_version: "encryptionkey@0"
I20260806 04:45:35.856491 11751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:35.875033 11751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:35.878888 11751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:35.879161 11751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:35.898017 11751 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:43393
I20260806 04:45:35.898030 11816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:43393 every 8 connection(s)
I20260806 04:45:35.898923 11751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:35.902452 11817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:35.909101 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 11751
I20260806 04:45:35.909335 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:35.910153 7623 external_mini_cluster.cc:1428] Setting key 2b9b0d82cd46c48e1b1f7b5880860458
I20260806 04:45:35.913367 11817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52: Bootstrap starting.
I20260806 04:45:35.916822 11817 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:35.917984 11817 log.cc:824] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:35.921025 11817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52: No bootstrap required, opened a new log
Aug 06 04:45:35 dist-test-slave-0b58 krb5kdc[11738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:35.931483 11817 raft_consensus.cc:348] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50784f229e141ffb3b5137750a6de52" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43393 } }
I20260806 04:45:35.931960 11817 raft_consensus.cc:374] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:35.932080 11817 raft_consensus.cc:729] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f50784f229e141ffb3b5137750a6de52, State: Initialized, Role: FOLLOWER
I20260806 04:45:35.932750 11817 consensus_queue.cc:260] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50784f229e141ffb3b5137750a6de52" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43393 } }
I20260806 04:45:35.933074 11817 raft_consensus.cc:388] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:35.933218 11817 raft_consensus.cc:482] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:35.933451 11817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:35.934916 11820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:35.912222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40902 (local address 127.7.113.254:43393)
0806 04:45:35.913076 (+ 854us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:35.913086 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:35.913124 (+ 38us) server_negotiation.cc:407] Connection header received
0806 04:45:35.914878 (+ 1754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:35.914899 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:35.915251 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:35.915547 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:35.917456 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:35.919152 (+ 1696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:35.920914 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:35.921649 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:35.921793 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:35.926307 (+ 4514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:35.926322 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:35.926341 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:35.926381 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:35.930368 (+ 3987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:35.931043 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:35.931052 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:35.931063 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:35.931267 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:35.931628 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:35.931633 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:35.931636 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:35.932398 (+ 762us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:35.932683 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:35.933075 (+ 392us) server_negotiation.cc:299] Negotiation successful
0806 04:45:35.933541 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":351,"threads_started":1}
I20260806 04:45:35.936338 11817 raft_consensus.cc:504] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50784f229e141ffb3b5137750a6de52" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43393 } }
I20260806 04:45:35.936841 11817 leader_election.cc:302] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f50784f229e141ffb3b5137750a6de52; no voters:
I20260806 04:45:35.937476 11817 leader_election.cc:288] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:35.937628 11822 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:35.938877 11822 raft_consensus.cc:686] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [term 1 LEADER]: Becoming Leader. State: Replica: f50784f229e141ffb3b5137750a6de52, State: Running, Role: LEADER
I20260806 04:45:35.939505 11817 sys_catalog.cc:564] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:35.939424 11822 consensus_queue.cc:237] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50784f229e141ffb3b5137750a6de52" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43393 } }
I20260806 04:45:35.942399 11825 sys_catalog.cc:455] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f50784f229e141ffb3b5137750a6de52. Latest consensus state: current_term: 1 leader_uuid: "f50784f229e141ffb3b5137750a6de52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50784f229e141ffb3b5137750a6de52" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43393 } } }
I20260806 04:45:35.942914 11825 sys_catalog.cc:458] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:35.942827 11823 sys_catalog.cc:455] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f50784f229e141ffb3b5137750a6de52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50784f229e141ffb3b5137750a6de52" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43393 } } }
I20260806 04:45:35.943420 11823 sys_catalog.cc:458] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:35.944617 11832 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:35.950127 11832 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:35.957923 11832 catalog_manager.cc:1347] Generated new cluster ID: 1dcc65e7a19c4b9c96b534c64ddac5ad
I20260806 04:45:35.958025 11832 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:35.978991 11832 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:35.980340 11832 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:35.990079 11832 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52: Generated new TSK 0
I20260806 04:45:35.990798 11832 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:45:36.053542 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:43393
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:36.383273 11844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:36.383517 11844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:36.383610 11844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:36.390609 11844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:36.390703 11844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:36.390810 11844 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:45:36.400298 11844 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:43393
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:36.401573 11844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:36.402854 11844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:36.416214 11850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:36.416282 11852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:36.416183 11849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:36.421690 11844 server_base.cc:1034] running on GCE node
I20260806 04:45:36.422260 11844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:36.423163 11844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:36.424378 11844 hybrid_clock.cc:648] HybridClock initialized: now 1785991536424324 us; error 49 us; skew 500 ppm
I20260806 04:45:36.424707 11844 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:36 dist-test-slave-0b58 krb5kdc[11738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991536, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:36.428010 11844 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:45:36.429349 11844 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:36.429440 11844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:36.429701 11844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:36.432904 11844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "344bc8751c4c4f9483434fb9af7f4822"
format_stamp: "Formatted at 2026-08-06 04:45:36 on dist-test-slave-0b58"
server_key: "fad2192c642d7a24524b591d963a0760"
server_key_iv: "70a7a7b227660c59eed70d57ceb73522"
server_key_version: "encryptionkey@0"
I20260806 04:45:36.433657 11844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "344bc8751c4c4f9483434fb9af7f4822"
format_stamp: "Formatted at 2026-08-06 04:45:36 on dist-test-slave-0b58"
server_key: "fad2192c642d7a24524b591d963a0760"
server_key_iv: "70a7a7b227660c59eed70d57ceb73522"
server_key_version: "encryptionkey@0"
I20260806 04:45:36.438582 11844 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 04:45:36.442200 11858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:36.443471 11844 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:45:36.443645 11844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "344bc8751c4c4f9483434fb9af7f4822"
format_stamp: "Formatted at 2026-08-06 04:45:36 on dist-test-slave-0b58"
server_key: "fad2192c642d7a24524b591d963a0760"
server_key_iv: "70a7a7b227660c59eed70d57ceb73522"
server_key_version: "encryptionkey@0"
I20260806 04:45:36.443883 11844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:36.466460 11844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:36.470399 11844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:36.470620 11844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:36.471487 11844 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:36.472754 11844 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:36.472851 11844 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:36.472923 11844 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:36.472977 11844 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:36.504518 11844 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:34521
I20260806 04:45:36.504536 11970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:34521 every 8 connection(s)
I20260806 04:45:36.505373 11844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:45:36.515000 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 11844
I20260806 04:45:36.515203 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:45:36.516010 7623 external_mini_cluster.cc:1428] Setting key d0f833064e07500e78617337bc102d4a
Aug 06 04:45:36 dist-test-slave-0b58 krb5kdc[11738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991536, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:36.527303 11973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:36.507731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:36277 (local address 127.7.113.254:43393)
0806 04:45:36.508184 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:36.508190 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:36.509191 (+ 1001us) server_negotiation.cc:407] Connection header received
0806 04:45:36.511674 (+ 2483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:36.511680 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:36.511801 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:36.511936 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:36.513554 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:36.514272 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:36.516722 (+ 2450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:36.517312 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:36.517446 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:36.520801 (+ 3355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:36.520806 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:36.520809 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:36.520839 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:36.523738 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:36.524690 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:36.524698 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:36.524704 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:36.524836 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:36.525303 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:36.525309 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:36.525315 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:36.525651 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:36.525800 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:36.526730 (+ 930us) server_negotiation.cc:299] Negotiation successful
0806 04:45:36.526958 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":213,"threads_started":1}
I20260806 04:45:36.528200 11974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:36.508300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:43393 (local address 127.7.113.193:36277)
0806 04:45:36.509008 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:36.509058 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:36.511403 (+ 2345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:36.512361 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:36.512369 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:36.512856 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:36.513377 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:36.513394 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:36.514410 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:36.514414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:36.516526 (+ 2112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:36.516541 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:36.517515 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:36.517520 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:36.517726 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:36.518431 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:36.518452 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:36.520576 (+ 2124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:36.523886 (+ 3310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:36.523897 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:36.523913 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:36.524570 (+ 657us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:36.524946 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:36.524953 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:36.524959 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:36.525188 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:36.525887 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:36.525896 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:36.526328 (+ 432us) client_negotiation.cc:769] Sending connection context
0806 04:45:36.526612 (+ 284us) client_negotiation.cc:240] Negotiation successful
0806 04:45:36.527101 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":263,"threads_started":1}
I20260806 04:45:36.529765 11971 heartbeater.cc:347] Connected to a master server at 127.7.113.254:43393
I20260806 04:45:36.530068 11971 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:36.530683 11971 heartbeater.cc:511] Master 127.7.113.254:43393 requested a full tablet report, sending...
I20260806 04:45:36.532891 11782 ts_manager.cc:194] Registered new tserver with Master: 344bc8751c4c4f9483434fb9af7f4822 (127.7.113.193:34521)
I20260806 04:45:36.535102 11782 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:36277
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:45:36.568109 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:43393
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:36.886508 11977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:36.886757 11977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:36.886915 11977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:36.893935 11977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:36.894047 11977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:36.894192 11977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:45:36.903717 11977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:43393
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:36.904928 11977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:36.906154 11977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:36.918185 11983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:36.918377 11982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:36.918370 11985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:36.919329 11977 server_base.cc:1034] running on GCE node
I20260806 04:45:36.919919 11977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:36.920802 11977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:36.922026 11977 hybrid_clock.cc:648] HybridClock initialized: now 1785991536921991 us; error 50 us; skew 500 ppm
I20260806 04:45:36.922333 11977 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:36 dist-test-slave-0b58 krb5kdc[11738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991536, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:36.925241 11977 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:45:36.926357 11977 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:36.926486 11977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:36.926777 11977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:36.929535 11977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "f701e1b3939b4e22912ad00c7df1d1a3"
format_stamp: "Formatted at 2026-08-06 04:45:36 on dist-test-slave-0b58"
server_key: "00d9f3340e5b79f3e90648627073e2c5"
server_key_iv: "0bb44f4da5b63ae3bac7b7e595738cbe"
server_key_version: "encryptionkey@0"
I20260806 04:45:36.930326 11977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "f701e1b3939b4e22912ad00c7df1d1a3"
format_stamp: "Formatted at 2026-08-06 04:45:36 on dist-test-slave-0b58"
server_key: "00d9f3340e5b79f3e90648627073e2c5"
server_key_iv: "0bb44f4da5b63ae3bac7b7e595738cbe"
server_key_version: "encryptionkey@0"
I20260806 04:45:36.935040 11977 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 04:45:36.938331 11991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:36.939627 11977 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:45:36.939790 11977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "f701e1b3939b4e22912ad00c7df1d1a3"
format_stamp: "Formatted at 2026-08-06 04:45:36 on dist-test-slave-0b58"
server_key: "00d9f3340e5b79f3e90648627073e2c5"
server_key_iv: "0bb44f4da5b63ae3bac7b7e595738cbe"
server_key_version: "encryptionkey@0"
I20260806 04:45:36.939996 11977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:36.967111 11977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:36.970770 11977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:36.971037 11977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:36.971949 11977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:36.973420 11977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:36.973567 11977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:36.973691 11977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:36.973788 11977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:37.007112 11977 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:38705
I20260806 04:45:37.007167 12103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:38705 every 8 connection(s)
I20260806 04:45:37.007982 11977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:45:37.008811 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 11977
I20260806 04:45:37.009008 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:45:37.009568 7623 external_mini_cluster.cc:1428] Setting key 2af3d91e247153d9c32c62485a59c8ef
Aug 06 04:45:37 dist-test-slave-0b58 krb5kdc[11738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991536, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:37.029862 11973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.010700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:58317 (local address 127.7.113.254:43393)
0806 04:45:37.010891 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:37.010897 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:37.012290 (+ 1393us) server_negotiation.cc:407] Connection header received
0806 04:45:37.014141 (+ 1851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:37.014158 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:37.014251 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:37.014364 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:37.016144 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.017305 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.019508 (+ 2203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.020250 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.020423 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.024026 (+ 3603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:37.024031 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:37.024035 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:37.024067 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:37.026739 (+ 2672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:37.027489 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:37.027496 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:37.027505 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:37.027637 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:37.028122 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:37.028127 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:37.028131 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:37.028473 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:37.028617 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:37.029375 (+ 758us) server_negotiation.cc:299] Negotiation successful
0806 04:45:37.029582 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 04:45:37.031462 12106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.011316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:43393 (local address 127.7.113.194:58317)
0806 04:45:37.012115 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:37.012156 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:37.013851 (+ 1695us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:37.014580 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:37.014592 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:37.015269 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:37.015951 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:37.015974 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.017449 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.017456 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:37.019291 (+ 1835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:37.019307 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.020474 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.020479 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:37.020656 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.021443 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:37.021470 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:37.023783 (+ 2313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:37.026899 (+ 3116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:37.026907 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:37.026922 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:37.027351 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:37.027758 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:37.027762 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:37.027766 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:37.028004 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:37.028610 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:37.028617 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:37.028951 (+ 334us) client_negotiation.cc:769] Sending connection context
0806 04:45:37.030118 (+ 1167us) client_negotiation.cc:240] Negotiation successful
0806 04:45:37.030504 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":341,"threads_started":1}
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
I20260806 04:45:37.033107 12104 heartbeater.cc:347] Connected to a master server at 127.7.113.254:43393
I20260806 04:45:37.033427 12104 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:37.034065 12104 heartbeater.cc:511] Master 127.7.113.254:43393 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
I20260806 04:45:37.035837 11782 ts_manager.cc:194] Registered new tserver with Master: f701e1b3939b4e22912ad00c7df1d1a3 (127.7.113.194:38705)
I20260806 04:45:37.037117 11782 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:58317
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:45:37.063701 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:43393
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:37.389676 12109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:37.389957 12109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:37.390115 12109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:37.397324 12109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:37.397451 12109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:37.397635 12109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:45:37.406937 12109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:43393
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:37.408126 12109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:37.409404 12109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:37.422170 12117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:37.422228 12115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:37.422325 12114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:37.422828 12109 server_base.cc:1034] running on GCE node
I20260806 04:45:37.423394 12109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:37.424329 12109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:37.425572 12109 hybrid_clock.cc:648] HybridClock initialized: now 1785991537425528 us; error 56 us; skew 500 ppm
I20260806 04:45:37.425882 12109 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:37 dist-test-slave-0b58 krb5kdc[11738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991537, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:37.434032 12109 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:45:37.435123 12109 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:37.435250 12109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:37.435597 12109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:37.438499 12109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "4fbdd30bb85945fdaff80f01a405b184"
format_stamp: "Formatted at 2026-08-06 04:45:37 on dist-test-slave-0b58"
server_key: "ad62d7d0f8db9796734dbfce38626df8"
server_key_iv: "686d7a8f9ceb3942e4849c7ce4a5c6cf"
server_key_version: "encryptionkey@0"
I20260806 04:45:37.439317 12109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "4fbdd30bb85945fdaff80f01a405b184"
format_stamp: "Formatted at 2026-08-06 04:45:37 on dist-test-slave-0b58"
server_key: "ad62d7d0f8db9796734dbfce38626df8"
server_key_iv: "686d7a8f9ceb3942e4849c7ce4a5c6cf"
server_key_version: "encryptionkey@0"
I20260806 04:45:37.444186 12109 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260806 04:45:37.447614 12123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:37.449028 12109 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 04:45:37.449180 12109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "4fbdd30bb85945fdaff80f01a405b184"
format_stamp: "Formatted at 2026-08-06 04:45:37 on dist-test-slave-0b58"
server_key: "ad62d7d0f8db9796734dbfce38626df8"
server_key_iv: "686d7a8f9ceb3942e4849c7ce4a5c6cf"
server_key_version: "encryptionkey@0"
I20260806 04:45:37.449405 12109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:37.482522 12109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:37.486420 12109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:37.486694 12109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:37.487630 12109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:37.488965 12109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:37.489049 12109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:37.489128 12109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:37.489182 12109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:37.523663 12109 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:43937
I20260806 04:45:37.523747 12235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:43937 every 8 connection(s)
I20260806 04:45:37.524561 12109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:45:37.528740 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 12109
I20260806 04:45:37.528937 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:45:37.529377 7623 external_mini_cluster.cc:1428] Setting key 8748fdfad2f1bdbc596795e4124847d2
Aug 06 04:45:37 dist-test-slave-0b58 krb5kdc[11738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991537, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:37.538034 11971 heartbeater.cc:503] Master 127.7.113.254:43393 was elected leader, sending a full tablet report...
I20260806 04:45:37.544893 11973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.527029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:55771 (local address 127.7.113.254:43393)
0806 04:45:37.527207 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:37.527211 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:37.528235 (+ 1024us) server_negotiation.cc:407] Connection header received
0806 04:45:37.530459 (+ 2224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:37.530463 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:37.530531 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:37.530659 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:37.532664 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.533424 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.534908 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.535303 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.535395 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.538758 (+ 3363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:37.538763 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:37.538768 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:37.538805 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:37.541648 (+ 2843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:37.542291 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:37.542294 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:37.542296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:37.542421 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:37.542773 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:37.542777 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:37.542780 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:37.543103 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:37.543220 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:37.544232 (+ 1012us) server_negotiation.cc:299] Negotiation successful
0806 04:45:37.544487 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 04:45:37.545845 12238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.527419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:43393 (local address 127.7.113.195:55771)
0806 04:45:37.528075 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:37.528117 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:37.530158 (+ 2041us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:37.530919 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:37.530927 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:37.531596 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:37.532484 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:37.532511 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.533549 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.533553 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:37.534749 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:37.534779 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.535490 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.535495 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:37.535667 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.536312 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:37.536345 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:37.538531 (+ 2186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:37.541765 (+ 3234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:37.541771 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:37.541782 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:37.542189 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:37.542508 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:37.542511 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:37.542513 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:37.542663 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:37.543236 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:37.543243 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:37.543745 (+ 502us) client_negotiation.cc:769] Sending connection context
0806 04:45:37.544103 (+ 358us) client_negotiation.cc:240] Negotiation successful
0806 04:45:37.544712 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":261,"threads_started":1}
I20260806 04:45:37.547144 12236 heartbeater.cc:347] Connected to a master server at 127.7.113.254:43393
I20260806 04:45:37.547448 12236 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:37.548105 12236 heartbeater.cc:511] Master 127.7.113.254:43393 requested a full tablet report, sending...
I20260806 04:45:37.549427 11782 ts_manager.cc:194] Registered new tserver with Master: 4fbdd30bb85945fdaff80f01a405b184 (127.7.113.195:43937)
I20260806 04:45:37.550173 11782 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:55771
I20260806 04:45:37.556814 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:45:37.578073 11973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.561450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40910 (local address 127.7.113.254:43393)
0806 04:45:37.561716 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:37.561722 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:37.562428 (+ 706us) server_negotiation.cc:407] Connection header received
0806 04:45:37.562723 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:37.562728 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:37.562836 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:37.562945 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:37.564549 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.565252 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.567316 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.568146 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.568312 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.571118 (+ 2806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:37.571126 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:37.571131 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:37.571173 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:37.574905 (+ 3732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:37.575843 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:37.575850 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:37.575854 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:37.576025 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:37.576568 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:37.576572 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:37.576576 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:37.576907 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:37.577176 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:37.577506 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 04:45:37.577708 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260806 04:45:37.583146 11782 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:45:37.593689 11782 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:45:37.618505 12248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.606482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:34521 (local address 127.0.0.1:33296)
0806 04:45:37.607240 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:37.607299 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:37.607464 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:37.608384 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:37.608391 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:37.608435 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:37.608837 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:37.608854 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.611700 (+ 2846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.611709 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:37.614904 (+ 3195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:37.614927 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.617494 (+ 2567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.617501 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:37.617727 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.617804 (+ 77us) client_negotiation.cc:769] Sending connection context
0806 04:45:37.617908 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 04:45:37.618095 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":927,"threads_started":1}
I20260806 04:45:37.620344 12249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.607018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33296 (local address 127.7.113.193:34521)
0806 04:45:37.607679 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:37.607688 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:37.607716 (+ 28us) server_negotiation.cc:407] Connection header received
0806 04:45:37.607808 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:37.607815 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:37.608076 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:37.609090 (+ 1014us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:37.609341 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.611501 (+ 2160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.615179 (+ 3678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.617229 (+ 2050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.619517 (+ 2288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.619763 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:37.619843 (+ 80us) server_negotiation.cc:299] Negotiation successful
0806 04:45:37.620003 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":2104,"threads_started":1}
I20260806 04:45:37.623944 11906 tablet_service.cc:1467] Processing CreateTablet for tablet 7abfac725d7447ccba15cedcf86ff1e3 (DEFAULT_TABLE table=test-table [id=ec9e1387c88745b795f1e8eab1899461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:37.625635 11906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7abfac725d7447ccba15cedcf86ff1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:37.625881 12252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.607384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:38705 (local address 127.0.0.1:41818)
0806 04:45:37.617563 (+ 10179us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:37.617582 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:37.617707 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:37.618717 (+ 1010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:37.618728 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:37.618765 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:37.619272 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:37.619296 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.621258 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.621263 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:37.622672 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:37.622684 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.624827 (+ 2143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.624837 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:37.625067 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.625109 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 04:45:37.625224 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 04:45:37.625466 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10050,"mutex_wait_us":104,"thread_start_us":11712,"threads_started":1}
I20260806 04:45:37.625890 12251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.607987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41818 (local address 127.7.113.194:38705)
0806 04:45:37.608565 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:37.608576 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:37.617713 (+ 9137us) server_negotiation.cc:407] Connection header received
0806 04:45:37.617844 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:37.617854 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:37.618151 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:37.618394 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:37.619438 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.621081 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.622851 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.624339 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.624480 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.624658 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:37.625374 (+ 716us) server_negotiation.cc:299] Negotiation successful
0806 04:45:37.625548 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":316,"threads_started":1}
I20260806 04:45:37.629604 12248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.608152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:43937 (local address 127.0.0.1:37712)
0806 04:45:37.619027 (+ 10875us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:37.619047 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:37.619160 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:37.619734 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:37.619738 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:37.619763 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:37.619982 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:37.619993 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.624999 (+ 5006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.625007 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:37.626733 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:37.626745 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.628840 (+ 2095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.628849 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:37.629019 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.629052 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 04:45:37.629143 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 04:45:37.629272 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10776,"mutex_wait_us":3,"thread_start_us":9623,"threads_started":1}
I20260806 04:45:37.629714 12039 tablet_service.cc:1467] Processing CreateTablet for tablet 7abfac725d7447ccba15cedcf86ff1e3 (DEFAULT_TABLE table=test-table [id=ec9e1387c88745b795f1e8eab1899461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:37.630702 12253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.608777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37712 (local address 127.7.113.195:43937)
0806 04:45:37.609695 (+ 918us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:37.609706 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:37.619330 (+ 9624us) server_negotiation.cc:407] Connection header received
0806 04:45:37.619409 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:37.619414 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:37.619561 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:37.619745 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:37.620168 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.624806 (+ 4638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.626889 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.628401 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.628524 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.628741 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:37.629864 (+ 1123us) server_negotiation.cc:299] Negotiation successful
0806 04:45:37.630018 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":490,"threads_started":1}
I20260806 04:45:37.631067 12039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7abfac725d7447ccba15cedcf86ff1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:37.634181 12171 tablet_service.cc:1467] Processing CreateTablet for tablet 7abfac725d7447ccba15cedcf86ff1e3 (DEFAULT_TABLE table=test-table [id=ec9e1387c88745b795f1e8eab1899461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:37.635476 12171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7abfac725d7447ccba15cedcf86ff1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:37.637988 12254 tablet_bootstrap.cc:492] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822: Bootstrap starting.
I20260806 04:45:37.641808 12254 tablet_bootstrap.cc:654] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:37.642915 12254 log.cc:824] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:37.645479 12256 tablet_bootstrap.cc:492] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3: Bootstrap starting.
I20260806 04:45:37.646473 12254 tablet_bootstrap.cc:492] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822: No bootstrap required, opened a new log
I20260806 04:45:37.646838 12254 ts_tablet_manager.cc:1397] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260806 04:45:37.649101 12256 tablet_bootstrap.cc:654] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:37.650244 12256 log.cc:824] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:37.652936 12257 tablet_bootstrap.cc:492] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184: Bootstrap starting.
I20260806 04:45:37.653501 12256 tablet_bootstrap.cc:492] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3: No bootstrap required, opened a new log
I20260806 04:45:37.653764 12256 ts_tablet_manager.cc:1397] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260806 04:45:37.656116 12257 tablet_bootstrap.cc:654] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:37.657097 12257 log.cc:824] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:37.657789 12254 raft_consensus.cc:348] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344bc8751c4c4f9483434fb9af7f4822" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34521 } } peers { permanent_uuid: "4fbdd30bb85945fdaff80f01a405b184" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43937 } } peers { permanent_uuid: "f701e1b3939b4e22912ad00c7df1d1a3" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38705 } }
I20260806 04:45:37.658257 12254 raft_consensus.cc:374] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:37.658360 12254 raft_consensus.cc:729] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344bc8751c4c4f9483434fb9af7f4822, State: Initialized, Role: FOLLOWER
I20260806 04:45:37.659036 12254 consensus_queue.cc:260] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344bc8751c4c4f9483434fb9af7f4822" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34521 } } peers { permanent_uuid: "4fbdd30bb85945fdaff80f01a405b184" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43937 } } peers { permanent_uuid: "f701e1b3939b4e22912ad00c7df1d1a3" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38705 } }
I20260806 04:45:37.660845 12254 ts_tablet_manager.cc:1428] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260806 04:45:37.661475 12257 tablet_bootstrap.cc:492] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184: No bootstrap required, opened a new log
I20260806 04:45:37.661736 12257 ts_tablet_manager.cc:1397] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 04:45:37.663386 12256 raft_consensus.cc:348] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344bc8751c4c4f9483434fb9af7f4822" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34521 } } peers { permanent_uuid: "4fbdd30bb85945fdaff80f01a405b184" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43937 } } peers { permanent_uuid: "f701e1b3939b4e22912ad00c7df1d1a3" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38705 } }
I20260806 04:45:37.663733 12256 raft_consensus.cc:374] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:37.663851 12256 raft_consensus.cc:729] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f701e1b3939b4e22912ad00c7df1d1a3, State: Initialized, Role: FOLLOWER
I20260806 04:45:37.664453 12256 consensus_queue.cc:260] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344bc8751c4c4f9483434fb9af7f4822" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34521 } } peers { permanent_uuid: "4fbdd30bb85945fdaff80f01a405b184" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43937 } } peers { permanent_uuid: "f701e1b3939b4e22912ad00c7df1d1a3" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38705 } }
I20260806 04:45:37.666003 12104 heartbeater.cc:503] Master 127.7.113.254:43393 was elected leader, sending a full tablet report...
I20260806 04:45:37.667801 12256 ts_tablet_manager.cc:1428] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260806 04:45:37.670358 12257 raft_consensus.cc:348] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344bc8751c4c4f9483434fb9af7f4822" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34521 } } peers { permanent_uuid: "4fbdd30bb85945fdaff80f01a405b184" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43937 } } peers { permanent_uuid: "f701e1b3939b4e22912ad00c7df1d1a3" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38705 } }
I20260806 04:45:37.670684 12257 raft_consensus.cc:374] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:37.670792 12257 raft_consensus.cc:729] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fbdd30bb85945fdaff80f01a405b184, State: Initialized, Role: FOLLOWER
I20260806 04:45:37.671252 12257 consensus_queue.cc:260] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344bc8751c4c4f9483434fb9af7f4822" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34521 } } peers { permanent_uuid: "4fbdd30bb85945fdaff80f01a405b184" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43937 } } peers { permanent_uuid: "f701e1b3939b4e22912ad00c7df1d1a3" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38705 } }
I20260806 04:45:37.672148 12236 heartbeater.cc:503] Master 127.7.113.254:43393 was elected leader, sending a full tablet report...
I20260806 04:45:37.672551 12257 ts_tablet_manager.cc:1428] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
W20260806 04:45:37.757700 11972 tablet.cc:2369] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:45:37.765057 12105 tablet.cc:2369] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:45:37.776027 12237 tablet.cc:2369] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:45:37.835721 12260 raft_consensus.cc:482] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:37.835988 12260 raft_consensus.cc:504] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344bc8751c4c4f9483434fb9af7f4822" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34521 } } peers { permanent_uuid: "4fbdd30bb85945fdaff80f01a405b184" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43937 } } peers { permanent_uuid: "f701e1b3939b4e22912ad00c7df1d1a3" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38705 } }
I20260806 04:45:37.837610 12260 leader_election.cc:288] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4fbdd30bb85945fdaff80f01a405b184 (127.7.113.195:43937), f701e1b3939b4e22912ad00c7df1d1a3 (127.7.113.194:38705)
I20260806 04:45:37.846776 12251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.838320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:55837 (local address 127.7.113.194:38705)
0806 04:45:37.838507 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:37.838511 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:37.839555 (+ 1044us) server_negotiation.cc:407] Connection header received
0806 04:45:37.839709 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:37.839717 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:37.839793 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:37.839870 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:37.840541 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.841574 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.844232 (+ 2658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.845556 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.845703 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.845777 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:37.846383 (+ 606us) server_negotiation.cc:299] Negotiation successful
0806 04:45:37.846518 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 04:45:37.846771 12253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.838202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:41045 (local address 127.7.113.195:43937)
0806 04:45:37.838463 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:37.838472 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:37.839110 (+ 638us) server_negotiation.cc:407] Connection header received
0806 04:45:37.839418 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:37.839422 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:37.839481 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:37.839589 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:37.840210 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.841430 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.844232 (+ 2802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.845557 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.845707 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.845777 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:37.846383 (+ 606us) server_negotiation.cc:299] Negotiation successful
0806 04:45:37.846513 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 04:45:37.847049 12263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.838248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:43937 (local address 127.7.113.193:41045)
0806 04:45:37.838996 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:37.839012 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:37.839229 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:37.839624 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:37.839632 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:37.839662 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:37.840066 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:37.840081 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.841546 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.841550 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:37.844068 (+ 2518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:37.844082 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.845881 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.845887 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:37.846165 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.846246 (+ 81us) client_negotiation.cc:769] Sending connection context
0806 04:45:37.846340 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 04:45:37.846553 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"mutex_wait_us":210,"thread_start_us":408,"threads_started":1}
I20260806 04:45:37.847092 12264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.838248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:38705 (local address 127.7.113.193:55837)
0806 04:45:37.839427 (+ 1179us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:37.839445 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:37.839591 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:37.839922 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:37.839926 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:37.839947 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:37.840382 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:37.840391 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.841696 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.841702 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:37.844067 (+ 2365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:37.844082 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.845866 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.845874 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:37.846160 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.846241 (+ 81us) client_negotiation.cc:769] Sending connection context
0806 04:45:37.846340 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 04:45:37.846553 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1051,"mutex_wait_us":414,"thread_start_us":583,"threads_started":1}
I20260806 04:45:37.848181 12191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7abfac725d7447ccba15cedcf86ff1e3" candidate_uuid: "344bc8751c4c4f9483434fb9af7f4822" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fbdd30bb85945fdaff80f01a405b184" is_pre_election: true
I20260806 04:45:37.848321 12059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7abfac725d7447ccba15cedcf86ff1e3" candidate_uuid: "344bc8751c4c4f9483434fb9af7f4822" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f701e1b3939b4e22912ad00c7df1d1a3" is_pre_election: true
I20260806 04:45:37.848793 12191 raft_consensus.cc:2454] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 344bc8751c4c4f9483434fb9af7f4822 in term 0.
I20260806 04:45:37.848944 12059 raft_consensus.cc:2454] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 344bc8751c4c4f9483434fb9af7f4822 in term 0.
I20260806 04:45:37.849421 11862 leader_election.cc:302] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344bc8751c4c4f9483434fb9af7f4822, 4fbdd30bb85945fdaff80f01a405b184; no voters:
I20260806 04:45:37.849809 12260 raft_consensus.cc:2781] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:45:37.849969 12260 raft_consensus.cc:482] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:45:37.850076 12260 raft_consensus.cc:3037] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:37.852445 12260 raft_consensus.cc:504] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344bc8751c4c4f9483434fb9af7f4822" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34521 } } peers { permanent_uuid: "4fbdd30bb85945fdaff80f01a405b184" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43937 } } peers { permanent_uuid: "f701e1b3939b4e22912ad00c7df1d1a3" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38705 } }
I20260806 04:45:37.853067 12260 leader_election.cc:288] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [CANDIDATE]: Term 1 election: Requested vote from peers 4fbdd30bb85945fdaff80f01a405b184 (127.7.113.195:43937), f701e1b3939b4e22912ad00c7df1d1a3 (127.7.113.194:38705)
I20260806 04:45:37.853452 12191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7abfac725d7447ccba15cedcf86ff1e3" candidate_uuid: "344bc8751c4c4f9483434fb9af7f4822" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fbdd30bb85945fdaff80f01a405b184"
I20260806 04:45:37.853636 12191 raft_consensus.cc:3037] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:37.853639 12059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7abfac725d7447ccba15cedcf86ff1e3" candidate_uuid: "344bc8751c4c4f9483434fb9af7f4822" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f701e1b3939b4e22912ad00c7df1d1a3"
I20260806 04:45:37.853843 12059 raft_consensus.cc:3037] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:37.855773 12191 raft_consensus.cc:2454] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 344bc8751c4c4f9483434fb9af7f4822 in term 1.
I20260806 04:45:37.856035 12059 raft_consensus.cc:2454] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 344bc8751c4c4f9483434fb9af7f4822 in term 1.
I20260806 04:45:37.856113 11862 leader_election.cc:302] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344bc8751c4c4f9483434fb9af7f4822, 4fbdd30bb85945fdaff80f01a405b184; no voters:
I20260806 04:45:37.856456 12260 raft_consensus.cc:2781] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:37.856879 12260 raft_consensus.cc:686] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [term 1 LEADER]: Becoming Leader. State: Replica: 344bc8751c4c4f9483434fb9af7f4822, State: Running, Role: LEADER
I20260806 04:45:37.857373 12260 consensus_queue.cc:237] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344bc8751c4c4f9483434fb9af7f4822" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34521 } } peers { permanent_uuid: "4fbdd30bb85945fdaff80f01a405b184" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43937 } } peers { permanent_uuid: "f701e1b3939b4e22912ad00c7df1d1a3" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38705 } }
I20260806 04:45:37.861837 11781 catalog_manager.cc:5495] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 reported cstate change: term changed from 0 to 1, leader changed from <none> to 344bc8751c4c4f9483434fb9af7f4822 (127.7.113.193). New cstate: current_term: 1 leader_uuid: "344bc8751c4c4f9483434fb9af7f4822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344bc8751c4c4f9483434fb9af7f4822" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4fbdd30bb85945fdaff80f01a405b184" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f701e1b3939b4e22912ad00c7df1d1a3" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38705 } health_report { overall_health: UNKNOWN } } }
I20260806 04:45:37.919864 12249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.914643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33308 (local address 127.7.113.193:34521)
0806 04:45:37.914878 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:37.914888 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:37.914922 (+ 34us) server_negotiation.cc:407] Connection header received
0806 04:45:37.915200 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:37.915208 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:37.915319 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:37.915482 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:37.915777 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.916572 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.917899 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.918277 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.918364 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.918788 (+ 424us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:37.919291 (+ 503us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:37.919403 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:37.919488 (+ 85us) server_negotiation.cc:299] Negotiation successful
0806 04:45:37.919560 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 04:45:37.928050 12191 raft_consensus.cc:1261] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184 [term 1 FOLLOWER]: Refusing update from remote peer 344bc8751c4c4f9483434fb9af7f4822: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:37.928057 12059 raft_consensus.cc:1261] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3 [term 1 FOLLOWER]: Refusing update from remote peer 344bc8751c4c4f9483434fb9af7f4822: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:37.929136 12265 consensus_queue.cc:1035] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f701e1b3939b4e22912ad00c7df1d1a3" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:37.929500 12260 consensus_queue.cc:1035] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fbdd30bb85945fdaff80f01a405b184" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:37.957553 11781 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:37.957895 11781 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:37.961962 11781 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f50784f229e141ffb3b5137750a6de52: Sending DeleteTablet for 3 replicas of tablet 7abfac725d7447ccba15cedcf86ff1e3
I20260806 04:45:37.963018 11906 tablet_service.cc:1514] Processing DeleteTablet for tablet 7abfac725d7447ccba15cedcf86ff1e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:37 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:33296
I20260806 04:45:37.963148 12039 tablet_service.cc:1514] Processing DeleteTablet for tablet 7abfac725d7447ccba15cedcf86ff1e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:37 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:41818
I20260806 04:45:37.963217 12171 tablet_service.cc:1514] Processing DeleteTablet for tablet 7abfac725d7447ccba15cedcf86ff1e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:37 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:37712
I20260806 04:45:37.967077 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 11844
I20260806 04:45:37.975638 12278 tablet_replica.cc:330] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3: stopping tablet replica
I20260806 04:45:37.976059 12278 raft_consensus.cc:2229] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:37.976584 12278 raft_consensus.cc:2258] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:37.977342 12279 tablet_replica.cc:330] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184: stopping tablet replica
I20260806 04:45:37.977715 12279 raft_consensus.cc:2229] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:37.978152 12279 raft_consensus.cc:2258] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:37.980080 12278 ts_tablet_manager.cc:1905] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:37.980428 12279 ts_tablet_manager.cc:1905] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:37.984781 12277 tablet_replica.cc:330] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822: stopping tablet replica
I20260806 04:45:37.985174 12277 raft_consensus.cc:2229] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:45:37.985889 12277 raft_consensus.cc:2258] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:37.987388 12279 ts_tablet_manager.cc:1918] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:45:37.987550 12279 log.cc:1196] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/7abfac725d7447ccba15cedcf86ff1e3
I20260806 04:45:37.987942 12277 ts_tablet_manager.cc:1905] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:37.988082 12279 ts_tablet_manager.cc:1939] T 7abfac725d7447ccba15cedcf86ff1e3 P 4fbdd30bb85945fdaff80f01a405b184: Deleting consensus metadata
Aug 06 04:45:37 dist-test-slave-0b58 krb5kdc[11738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:45:37.989929 11769 catalog_manager.cc:4841] TS 4fbdd30bb85945fdaff80f01a405b184 (127.7.113.195:43937): tablet 7abfac725d7447ccba15cedcf86ff1e3 (table test-table [id=ec9e1387c88745b795f1e8eab1899461]) successfully deleted
I20260806 04:45:37.993296 12278 ts_tablet_manager.cc:1918] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:45:37.993466 12278 log.cc:1196] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/7abfac725d7447ccba15cedcf86ff1e3
I20260806 04:45:37.994015 12278 ts_tablet_manager.cc:1939] T 7abfac725d7447ccba15cedcf86ff1e3 P f701e1b3939b4e22912ad00c7df1d1a3: Deleting consensus metadata
I20260806 04:45:37.995771 11767 catalog_manager.cc:4841] TS f701e1b3939b4e22912ad00c7df1d1a3 (127.7.113.194:38705): tablet 7abfac725d7447ccba15cedcf86ff1e3 (table test-table [id=ec9e1387c88745b795f1e8eab1899461]) successfully deleted
I20260806 04:45:37.997043 12277 ts_tablet_manager.cc:1918] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:45:37.997223 12277 log.cc:1196] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/7abfac725d7447ccba15cedcf86ff1e3
I20260806 04:45:37.997799 12277 ts_tablet_manager.cc:1939] T 7abfac725d7447ccba15cedcf86ff1e3 P 344bc8751c4c4f9483434fb9af7f4822: Deleting consensus metadata
I20260806 04:45:37.999171 12249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:37.968739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33320 (local address 127.7.113.193:34521)
0806 04:45:37.968960 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:37.968968 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:37.977669 (+ 8701us) server_negotiation.cc:407] Connection header received
0806 04:45:37.978044 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:37.978053 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:37.978167 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:37.978261 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:37.980301 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.981518 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.983370 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:37.984067 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:37.984188 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:37.990382 (+ 6194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:37.990401 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:37.990419 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:37.990464 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:37.994710 (+ 4246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:37.995708 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:37.995717 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:37.995721 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:37.995965 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:37.996450 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:37.996455 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:37.996459 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:37.996908 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:37.997223 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:37.998522 (+ 1299us) server_negotiation.cc:299] Negotiation successful
0806 04:45:37.998768 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 04:45:37.999464 11769 catalog_manager.cc:4841] TS 344bc8751c4c4f9483434fb9af7f4822 (127.7.113.193:34521): tablet 7abfac725d7447ccba15cedcf86ff1e3 (table test-table [id=ec9e1387c88745b795f1e8eab1899461]) successfully deleted
I20260806 04:45:37.999950 11966 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:38.097671 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 11844
I20260806 04:45:38.116945 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 11977
Aug 06 04:45:38 dist-test-slave-0b58 krb5kdc[11738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:45:38.131551 12251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:38.117702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41830 (local address 127.7.113.194:38705)
0806 04:45:38.117878 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:38.117882 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:38.117974 (+ 92us) server_negotiation.cc:407] Connection header received
0806 04:45:38.118118 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:38.118122 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:38.118184 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:38.118266 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:38.119524 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:38.120424 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:38.121642 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:38.122006 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:38.122093 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:38.126063 (+ 3970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:38.126077 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:38.126092 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:38.126130 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:38.129104 (+ 2974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:38.129714 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:38.129721 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:38.129723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:38.129937 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:38.130296 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:38.130299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:38.130301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:38.130648 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:38.130852 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:38.131108 (+ 256us) server_negotiation.cc:299] Negotiation successful
0806 04:45:38.131264 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 04:45:38.132205 12099 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:38.220224 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 11977
I20260806 04:45:38.240957 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 12109
Aug 06 04:45:38 dist-test-slave-0b58 krb5kdc[11738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:45:38.255297 12253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:38.241721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37720 (local address 127.7.113.195:43937)
0806 04:45:38.241888 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:38.241893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:38.241911 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:45:38.242049 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:38.242053 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:38.242118 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:38.242209 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:38.243406 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:38.244172 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:38.245544 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:38.245938 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:38.246029 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:38.250245 (+ 4216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:38.250260 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:38.250276 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:38.250306 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:38.252915 (+ 2609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:38.253512 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:38.253518 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:38.253520 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:38.253654 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:38.254027 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:38.254030 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:38.254032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:38.254353 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:38.254568 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:38.254766 (+ 198us) server_negotiation.cc:299] Negotiation successful
0806 04:45:38.254926 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 04:45:38.255921 12231 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:38.343560 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 12109
I20260806 04:45:38.362454 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 11751
I20260806 04:45:38.363556 11812 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:38.470011 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 11751
2026-08-06T04:45:38Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4299 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-06T04:45:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:38Z Disabled control of system clock
I20260806 04:45:38.543629 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:38399
--webserver_interface=127.7.113.254
--webserver_port=0
--builtin_ntp_servers=127.7.113.212:33199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:38399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 04:45:38.862903 12288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:38.863169 12288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:38.863302 12288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:38.870463 12288 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:38.870560 12288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:38.870625 12288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:38.870704 12288 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:38.870775 12288 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:45:38.879696 12288 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:33199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:38399
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:38399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:38.881021 12288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:38.882747 12288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:38.894694 12296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:38.894773 12293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:38.894752 12294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:38.895874 12288 server_base.cc:1034] running on GCE node
I20260806 04:45:38.896701 12288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:38.898070 12288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:38.899298 12288 hybrid_clock.cc:648] HybridClock initialized: now 1785991538899249 us; error 43 us; skew 500 ppm
I20260806 04:45:38.899646 12288 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:45:38.907967 12288 webserver.cc:460] Webserver started at http://127.7.113.254:46191/ using document root <none> and password file <none>
I20260806 04:45:38.908721 12288 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:38.908856 12288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:38.909186 12288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:38.912050 12288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "1920be416ed040b5b81a190e525318b3"
format_stamp: "Formatted at 2026-08-06 04:45:38 on dist-test-slave-0b58"
server_key: "76c32e0a3cc093123ded9565b245b26e"
server_key_iv: "f71a824be95495770acffef7a8d0be8c"
server_key_version: "encryptionkey@0"
I20260806 04:45:38.912930 12288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "1920be416ed040b5b81a190e525318b3"
format_stamp: "Formatted at 2026-08-06 04:45:38 on dist-test-slave-0b58"
server_key: "76c32e0a3cc093123ded9565b245b26e"
server_key_iv: "f71a824be95495770acffef7a8d0be8c"
server_key_version: "encryptionkey@0"
I20260806 04:45:38.917891 12288 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:45:38.921310 12302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:38.922602 12288 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:45:38.922791 12288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "1920be416ed040b5b81a190e525318b3"
format_stamp: "Formatted at 2026-08-06 04:45:38 on dist-test-slave-0b58"
server_key: "76c32e0a3cc093123ded9565b245b26e"
server_key_iv: "f71a824be95495770acffef7a8d0be8c"
server_key_version: "encryptionkey@0"
I20260806 04:45:38.923012 12288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:38.928661 12288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:38.929402 12288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:38.929699 12288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:38.947652 12288 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:38399
I20260806 04:45:38.947685 12354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:38399 every 8 connection(s)
I20260806 04:45:38.949084 12288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:38.952296 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 12288
I20260806 04:45:38.952525 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:38.952754 12355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:38.953248 7623 external_mini_cluster.cc:1428] Setting key 5ce9042016eab93817c7bf4f986f9844
I20260806 04:45:38.961884 12358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:38.955180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37134 (local address 127.7.113.254:38399)
0806 04:45:38.956337 (+ 1157us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:38.956348 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:38.956389 (+ 41us) server_negotiation.cc:407] Connection header received
0806 04:45:38.958445 (+ 2056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:38.958467 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:38.958871 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:38.959185 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:38.960347 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:38.960352 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:38.960364 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:38.960379 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:38.960439 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:38.960454 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:38.960611 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:38.960772 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 04:45:38.961018 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":426,"threads_started":1}
I20260806 04:45:38.965121 12355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3: Bootstrap starting.
I20260806 04:45:38.967911 12355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:38.969009 12355 log.cc:824] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:38.971544 12355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3: No bootstrap required, opened a new log
I20260806 04:45:38.978729 12355 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1920be416ed040b5b81a190e525318b3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38399 } }
I20260806 04:45:38.979064 12355 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:38.979171 12355 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1920be416ed040b5b81a190e525318b3, State: Initialized, Role: FOLLOWER
I20260806 04:45:38.979768 12355 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1920be416ed040b5b81a190e525318b3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38399 } }
I20260806 04:45:38.980036 12355 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:38.980190 12355 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:38.980437 12355 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:38.982465 12355 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1920be416ed040b5b81a190e525318b3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38399 } }
I20260806 04:45:38.982942 12355 leader_election.cc:302] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1920be416ed040b5b81a190e525318b3; no voters:
I20260806 04:45:38.983475 12355 leader_election.cc:288] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:38.983601 12360 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:38.984370 12360 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [term 1 LEADER]: Becoming Leader. State: Replica: 1920be416ed040b5b81a190e525318b3, State: Running, Role: LEADER
I20260806 04:45:38.984889 12360 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1920be416ed040b5b81a190e525318b3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38399 } }
I20260806 04:45:38.985504 12355 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:38.987483 12361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1920be416ed040b5b81a190e525318b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1920be416ed040b5b81a190e525318b3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38399 } } }
I20260806 04:45:38.987866 12361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:38.989151 12362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1920be416ed040b5b81a190e525318b3. Latest consensus state: current_term: 1 leader_uuid: "1920be416ed040b5b81a190e525318b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1920be416ed040b5b81a190e525318b3" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38399 } } }
I20260806 04:45:38.989558 12362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:38.993419 12365 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:38.998612 12365 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:39.007392 12365 catalog_manager.cc:1347] Generated new cluster ID: ea6b458d1f2448afacd6be6536a56987
I20260806 04:45:39.007514 12365 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:39.040135 12365 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:39.040563 12365 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:39.053529 12365 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3: Generated new TSK 0
I20260806 04:45:39.054273 12365 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:45:39.060835 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38399
--builtin_ntp_servers=127.7.113.212:33199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 04:45:39.403982 12380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:39.404240 12380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:39.404398 12380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:39.411506 12380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:39.411592 12380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:39.411758 12380 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:45:39.420758 12380 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:33199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38399
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:39.421872 12380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:39.423516 12380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:39.437393 12386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:39.437422 12385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:39.437467 12388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:39.438166 12380 server_base.cc:1034] running on GCE node
I20260806 04:45:39.438679 12380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:39.439476 12380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:39.440665 12380 hybrid_clock.cc:648] HybridClock initialized: now 1785991539440626 us; error 31 us; skew 500 ppm
I20260806 04:45:39.440927 12380 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:45:39.442903 12380 webserver.cc:460] Webserver started at http://127.7.113.193:36447/ using document root <none> and password file <none>
I20260806 04:45:39.443462 12380 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:39.443542 12380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:39.443799 12380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:39.446468 12380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "66435b66dd5d4227b6dee2e81d50b8c2"
format_stamp: "Formatted at 2026-08-06 04:45:39 on dist-test-slave-0b58"
server_key: "3db6c7314f7eb9b7579624bb70358410"
server_key_iv: "4372d4f5719f281b8a6beb17473e5d2a"
server_key_version: "encryptionkey@0"
I20260806 04:45:39.447165 12380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "66435b66dd5d4227b6dee2e81d50b8c2"
format_stamp: "Formatted at 2026-08-06 04:45:39 on dist-test-slave-0b58"
server_key: "3db6c7314f7eb9b7579624bb70358410"
server_key_iv: "4372d4f5719f281b8a6beb17473e5d2a"
server_key_version: "encryptionkey@0"
I20260806 04:45:39.451799 12380 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260806 04:45:39.454998 12394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:39.456171 12380 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 04:45:39.456382 12380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "66435b66dd5d4227b6dee2e81d50b8c2"
format_stamp: "Formatted at 2026-08-06 04:45:39 on dist-test-slave-0b58"
server_key: "3db6c7314f7eb9b7579624bb70358410"
server_key_iv: "4372d4f5719f281b8a6beb17473e5d2a"
server_key_version: "encryptionkey@0"
I20260806 04:45:39.456617 12380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:39.461949 12380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:39.462671 12380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:39.462960 12380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:39.463798 12380 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:39.465222 12380 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:39.465342 12380 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:39.465471 12380 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:39.465559 12380 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:39.501755 12380 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:39081
I20260806 04:45:39.501837 12507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:39081 every 8 connection(s)
I20260806 04:45:39.502987 12380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:45:39.505817 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 12380
I20260806 04:45:39.506037 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:45:39.506932 7623 external_mini_cluster.cc:1428] Setting key 179ced1b6554939d7dbc0e915a1fae3a
I20260806 04:45:39.509810 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38399
--builtin_ntp_servers=127.7.113.212:33199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 04:45:39.511859 12510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:39.505395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:54547 (local address 127.7.113.254:38399)
0806 04:45:39.505843 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:39.505847 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:39.507232 (+ 1385us) server_negotiation.cc:407] Connection header received
0806 04:45:39.509538 (+ 2306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:39.509543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:39.509615 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:39.509737 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:39.511086 (+ 1349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:39.511091 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:39.511095 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:39.511113 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:39.511164 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:39.511176 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:39.511303 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:39.511505 (+ 202us) server_negotiation.cc:299] Negotiation successful
0806 04:45:39.511573 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":257,"threads_started":1}
I20260806 04:45:39.512913 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:39.506080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38399 (local address 127.7.113.193:54547)
0806 04:45:39.507076 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:39.507120 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:39.509296 (+ 2176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:39.509980 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:39.509993 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:39.510123 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:39.510807 (+ 684us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:45:39.510809 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:39.510844 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:45:39.510926 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:39.511284 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:39.511294 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:39.511301 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 04:45:39.511580 (+ 279us) client_negotiation.cc:240] Negotiation successful
0806 04:45:39.511835 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":314,"threads_started":1}
I20260806 04:45:39.514647 12508 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38399
I20260806 04:45:39.514950 12508 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:39.515538 12508 heartbeater.cc:511] Master 127.7.113.254:38399 requested a full tablet report, sending...
I20260806 04:45:39.517766 12320 ts_manager.cc:194] Registered new tserver with Master: 66435b66dd5d4227b6dee2e81d50b8c2 (127.7.113.193:39081)
W20260806 04:45:39.829186 12512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:39.829444 12512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:39.829531 12512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:39.837375 12512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:39.837464 12512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:39.837581 12512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:45:39.846397 12512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:33199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38399
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:39.847496 12512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:39.849205 12512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:39.861891 12517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:39.861968 12518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:39.861999 12520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:39.862990 12512 server_base.cc:1034] running on GCE node
I20260806 04:45:39.863620 12512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:39.864583 12512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:39.865793 12512 hybrid_clock.cc:648] HybridClock initialized: now 1785991539865759 us; error 29 us; skew 500 ppm
I20260806 04:45:39.866092 12512 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:45:39.868170 12512 webserver.cc:460] Webserver started at http://127.7.113.194:39681/ using document root <none> and password file <none>
I20260806 04:45:39.868853 12512 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:39.868969 12512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:39.869293 12512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:39.871959 12512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "c000dcf28d9e452aa966b39557227d2d"
format_stamp: "Formatted at 2026-08-06 04:45:39 on dist-test-slave-0b58"
server_key: "06bc28241de994f1c2c79a43a318d616"
server_key_iv: "2f809c6d3fc630dffd4a813d489ddab8"
server_key_version: "encryptionkey@0"
I20260806 04:45:39.872843 12512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "c000dcf28d9e452aa966b39557227d2d"
format_stamp: "Formatted at 2026-08-06 04:45:39 on dist-test-slave-0b58"
server_key: "06bc28241de994f1c2c79a43a318d616"
server_key_iv: "2f809c6d3fc630dffd4a813d489ddab8"
server_key_version: "encryptionkey@0"
I20260806 04:45:39.877720 12512 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 04:45:39.881124 12526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:39.882342 12512 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:45:39.882512 12512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "c000dcf28d9e452aa966b39557227d2d"
format_stamp: "Formatted at 2026-08-06 04:45:39 on dist-test-slave-0b58"
server_key: "06bc28241de994f1c2c79a43a318d616"
server_key_iv: "2f809c6d3fc630dffd4a813d489ddab8"
server_key_version: "encryptionkey@0"
I20260806 04:45:39.882740 12512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:39.888195 12512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:39.888965 12512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:39.889194 12512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:39.890012 12512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:39.891309 12512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:39.891417 12512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:39.891568 12512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:39.891664 12512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:39.924618 12512 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:45291
I20260806 04:45:39.924707 12639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:45291 every 8 connection(s)
I20260806 04:45:39.925922 12512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:45:39.933458 12510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:39.928504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:38311 (local address 127.7.113.254:38399)
0806 04:45:39.928681 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:39.928685 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:39.930025 (+ 1340us) server_negotiation.cc:407] Connection header received
0806 04:45:39.931573 (+ 1548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:39.931577 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:39.931630 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:39.931714 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:39.932894 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:39.932898 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:39.932901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:39.932917 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:39.932948 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:39.932960 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:39.933051 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:39.933187 (+ 136us) server_negotiation.cc:299] Negotiation successful
0806 04:45:39.933235 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 04:45:39.933979 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 12512
I20260806 04:45:39.934166 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:45:39.934468 12642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:39.928999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38399 (local address 127.7.113.194:38311)
0806 04:45:39.929876 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:39.929917 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:39.931358 (+ 1441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:39.931893 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:39.931900 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:39.931977 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:39.932603 (+ 626us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:45:39.932605 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:39.932639 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:45:39.932718 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:39.933036 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:39.933040 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:39.933045 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 04:45:39.933262 (+ 217us) client_negotiation.cc:240] Negotiation successful
0806 04:45:39.933485 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":259,"threads_started":1}
I20260806 04:45:39.934729 7623 external_mini_cluster.cc:1428] Setting key 2c96020e37c3bedbe8edb0698932fc3c
I20260806 04:45:39.935930 12640 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38399
I20260806 04:45:39.936219 12640 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:39.936780 12640 heartbeater.cc:511] Master 127.7.113.254:38399 requested a full tablet report, sending...
I20260806 04:45:39.937657 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38399
--builtin_ntp_servers=127.7.113.212:33199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 04:45:39.938092 12320 ts_manager.cc:194] Registered new tserver with Master: c000dcf28d9e452aa966b39557227d2d (127.7.113.194:45291)
W20260806 04:45:40.270257 12643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:40.270524 12643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:40.270612 12643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:40.277725 12643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:40.277814 12643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:40.277938 12643 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:45:40.286948 12643 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:33199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38399
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:40.288120 12643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:40.289893 12643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:40.302636 12648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:40.302611 12649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:40.302677 12651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:40.303730 12643 server_base.cc:1034] running on GCE node
I20260806 04:45:40.304421 12643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:40.305301 12643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:40.306531 12643 hybrid_clock.cc:648] HybridClock initialized: now 1785991540306482 us; error 40 us; skew 500 ppm
I20260806 04:45:40.306841 12643 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:45:40.309088 12643 webserver.cc:460] Webserver started at http://127.7.113.195:43001/ using document root <none> and password file <none>
I20260806 04:45:40.309821 12643 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:40.309959 12643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:40.310279 12643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:40.313084 12643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "31abbb9fadd74253b44646921c21765f"
format_stamp: "Formatted at 2026-08-06 04:45:40 on dist-test-slave-0b58"
server_key: "ffb4fce82d35eb44dd44d4d6a83152b2"
server_key_iv: "b8172ef5f0c4fde71ea94cd4e55a926e"
server_key_version: "encryptionkey@0"
I20260806 04:45:40.313851 12643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "31abbb9fadd74253b44646921c21765f"
format_stamp: "Formatted at 2026-08-06 04:45:40 on dist-test-slave-0b58"
server_key: "ffb4fce82d35eb44dd44d4d6a83152b2"
server_key_iv: "b8172ef5f0c4fde71ea94cd4e55a926e"
server_key_version: "encryptionkey@0"
I20260806 04:45:40.318630 12643 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 04:45:40.321812 12657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:40.322995 12643 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 04:45:40.323158 12643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "31abbb9fadd74253b44646921c21765f"
format_stamp: "Formatted at 2026-08-06 04:45:40 on dist-test-slave-0b58"
server_key: "ffb4fce82d35eb44dd44d4d6a83152b2"
server_key_iv: "b8172ef5f0c4fde71ea94cd4e55a926e"
server_key_version: "encryptionkey@0"
I20260806 04:45:40.323390 12643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:40.328962 12643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:40.329668 12643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:40.329973 12643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:40.330835 12643 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:40.332149 12643 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:40.332348 12643 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:40.332480 12643 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:40.332567 12643 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:40.365252 12643 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:38115
I20260806 04:45:40.365350 12770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:38115 every 8 connection(s)
I20260806 04:45:40.366542 12643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:45:40.371939 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 12643
I20260806 04:45:40.372128 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:45:40.372709 7623 external_mini_cluster.cc:1428] Setting key d59ed6c2071fc16ef76efefc821b7898
I20260806 04:45:40.374910 12510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.369035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:33735 (local address 127.7.113.254:38399)
0806 04:45:40.369255 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:40.369262 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:40.370548 (+ 1286us) server_negotiation.cc:407] Connection header received
0806 04:45:40.372472 (+ 1924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:40.372477 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:40.372527 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:40.372611 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:40.374116 (+ 1505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:40.374123 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:40.374128 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:40.374145 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:40.374183 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:40.374200 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:40.374299 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:40.374560 (+ 261us) server_negotiation.cc:299] Negotiation successful
0806 04:45:40.374633 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 04:45:40.375913 12773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.369566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38399 (local address 127.7.113.195:33735)
0806 04:45:40.370406 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:40.370446 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:40.372170 (+ 1724us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:40.372858 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:40.372868 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:40.372998 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:40.373753 (+ 755us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:45:40.373758 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:40.373815 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:45:40.373896 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:40.374321 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:40.374332 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:40.374340 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 04:45:40.374627 (+ 287us) client_negotiation.cc:240] Negotiation successful
0806 04:45:40.374857 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":260,"threads_started":1}
I20260806 04:45:40.377092 12771 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38399
I20260806 04:45:40.377336 12771 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:40.377810 12771 heartbeater.cc:511] Master 127.7.113.254:38399 requested a full tablet report, sending...
I20260806 04:45:40.379038 12320 ts_manager.cc:194] Registered new tserver with Master: 31abbb9fadd74253b44646921c21765f (127.7.113.195:38115)
I20260806 04:45:40.388026 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:45:40.394901 12510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.392304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37140 (local address 127.7.113.254:38399)
0806 04:45:40.392455 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:40.392459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:40.392972 (+ 513us) server_negotiation.cc:407] Connection header received
0806 04:45:40.393149 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:40.393154 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:40.393213 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:40.393324 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:40.394238 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:40.394244 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:40.394248 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:40.394266 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:40.394310 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:40.394322 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:40.394448 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:40.394567 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 04:45:40.394626 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 04:45:40.398535 12320 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:45:40.405191 12320 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:45:40.436846 12785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.416543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39081 (local address 127.0.0.1:59880)
0806 04:45:40.429966 (+ 13423us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:40.430010 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:40.430135 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:40.434087 (+ 3952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:40.434094 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:40.434179 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:40.435227 (+ 1048us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:45:40.435230 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:40.435258 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:45:40.435352 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:40.435968 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:40.435980 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:40.435986 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 04:45:40.436163 (+ 177us) client_negotiation.cc:240] Negotiation successful
0806 04:45:40.436298 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13199,"thread_start_us":18099,"threads_started":1}
I20260806 04:45:40.437062 12784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.416686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59880 (local address 127.7.113.193:39081)
0806 04:45:40.432219 (+ 15533us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:40.432232 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:40.432266 (+ 34us) server_negotiation.cc:407] Connection header received
0806 04:45:40.432594 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:40.432605 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:40.432861 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:40.433043 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:40.435764 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:40.435771 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:40.435786 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:40.435801 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:40.435850 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:40.435865 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:40.436015 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:40.436610 (+ 595us) server_negotiation.cc:299] Negotiation successful
0806 04:45:40.436737 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15333,"thread_start_us":15609,"threads_started":1}
I20260806 04:45:40.438500 12788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.417716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48340 (local address 127.7.113.194:45291)
0806 04:45:40.434459 (+ 16743us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:40.434467 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:40.435182 (+ 715us) server_negotiation.cc:407] Connection header received
0806 04:45:40.435260 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:40.435267 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:40.435468 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:40.435605 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:40.437608 (+ 2003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:40.437618 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:40.437629 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:40.437649 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:40.437707 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:40.437728 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:40.437872 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:40.438080 (+ 208us) server_negotiation.cc:299] Negotiation successful
0806 04:45:40.438178 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16548,"thread_start_us":16620,"threads_started":1}
I20260806 04:45:40.438594 12783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.417102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:45291 (local address 127.0.0.1:48340)
0806 04:45:40.434928 (+ 17826us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:40.434948 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:40.435047 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:40.436104 (+ 1057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:40.436111 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:40.436138 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:40.437349 (+ 1211us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:45:40.437353 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:40.437372 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:45:40.437414 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:40.437930 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:40.437941 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:40.437945 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 04:45:40.438105 (+ 160us) client_negotiation.cc:240] Negotiation successful
0806 04:45:40.438159 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17677,"thread_start_us":16730,"threads_started":1}
I20260806 04:45:40.439306 12787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.417265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60170 (local address 127.7.113.195:38115)
0806 04:45:40.435346 (+ 18081us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:40.435353 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:40.435383 (+ 30us) server_negotiation.cc:407] Connection header received
0806 04:45:40.435445 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:40.435452 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:40.435638 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:40.435781 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:40.437674 (+ 1893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:40.437683 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:40.437695 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:40.437713 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:40.437767 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:40.437787 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:40.437962 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:40.438852 (+ 890us) server_negotiation.cc:299] Negotiation successful
0806 04:45:40.438941 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17902,"thread_start_us":18132,"threads_started":1}
I20260806 04:45:40.439905 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.416748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:38115 (local address 127.0.0.1:60170)
0806 04:45:40.434137 (+ 17389us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:40.434158 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:40.434261 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:40.436495 (+ 2234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:40.436500 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:40.436528 (+ 28us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:40.437423 (+ 895us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:45:40.437426 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:40.437442 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:45:40.437488 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:40.438020 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:40.438025 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:40.438030 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 04:45:40.438177 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 04:45:40.438235 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17226,"thread_start_us":12850,"threads_started":1}
I20260806 04:45:40.441257 12442 tablet_service.cc:1467] Processing CreateTablet for tablet a20129cea4754009aa4c014aad0ea616 (DEFAULT_TABLE table=test-table [id=d672d15f9a174b39a9fcf8d40213a7b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:40.442709 12442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a20129cea4754009aa4c014aad0ea616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:40.442291 12574 tablet_service.cc:1467] Processing CreateTablet for tablet a20129cea4754009aa4c014aad0ea616 (DEFAULT_TABLE table=test-table [id=d672d15f9a174b39a9fcf8d40213a7b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:40.443630 12574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a20129cea4754009aa4c014aad0ea616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:40.443351 12705 tablet_service.cc:1467] Processing CreateTablet for tablet a20129cea4754009aa4c014aad0ea616 (DEFAULT_TABLE table=test-table [id=d672d15f9a174b39a9fcf8d40213a7b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:40.444746 12705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a20129cea4754009aa4c014aad0ea616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:40.454469 12789 tablet_bootstrap.cc:492] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2: Bootstrap starting.
I20260806 04:45:40.458316 12790 tablet_bootstrap.cc:492] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d: Bootstrap starting.
I20260806 04:45:40.458426 12789 tablet_bootstrap.cc:654] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:40.459743 12789 log.cc:824] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:40.461107 12791 tablet_bootstrap.cc:492] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f: Bootstrap starting.
I20260806 04:45:40.462267 12790 tablet_bootstrap.cc:654] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:40.463562 12790 log.cc:824] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:40.464419 12791 tablet_bootstrap.cc:654] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:40.464564 12789 tablet_bootstrap.cc:492] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2: No bootstrap required, opened a new log
I20260806 04:45:40.464944 12789 ts_tablet_manager.cc:1397] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260806 04:45:40.465652 12791 log.cc:824] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:40.467218 12790 tablet_bootstrap.cc:492] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d: No bootstrap required, opened a new log
I20260806 04:45:40.467464 12790 ts_tablet_manager.cc:1397] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 04:45:40.468087 12791 tablet_bootstrap.cc:492] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f: No bootstrap required, opened a new log
I20260806 04:45:40.468376 12791 ts_tablet_manager.cc:1397] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.004s
I20260806 04:45:40.475324 12791 raft_consensus.cc:348] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39081 } } peers { permanent_uuid: "31abbb9fadd74253b44646921c21765f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 38115 } } peers { permanent_uuid: "c000dcf28d9e452aa966b39557227d2d" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45291 } }
I20260806 04:45:40.475363 12789 raft_consensus.cc:348] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39081 } } peers { permanent_uuid: "31abbb9fadd74253b44646921c21765f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 38115 } } peers { permanent_uuid: "c000dcf28d9e452aa966b39557227d2d" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45291 } }
I20260806 04:45:40.475687 12791 raft_consensus.cc:374] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:40.475800 12789 raft_consensus.cc:374] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:40.475826 12791 raft_consensus.cc:729] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31abbb9fadd74253b44646921c21765f, State: Initialized, Role: FOLLOWER
I20260806 04:45:40.475912 12789 raft_consensus.cc:729] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66435b66dd5d4227b6dee2e81d50b8c2, State: Initialized, Role: FOLLOWER
I20260806 04:45:40.476480 12791 consensus_queue.cc:260] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39081 } } peers { permanent_uuid: "31abbb9fadd74253b44646921c21765f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 38115 } } peers { permanent_uuid: "c000dcf28d9e452aa966b39557227d2d" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45291 } }
I20260806 04:45:40.476577 12789 consensus_queue.cc:260] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39081 } } peers { permanent_uuid: "31abbb9fadd74253b44646921c21765f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 38115 } } peers { permanent_uuid: "c000dcf28d9e452aa966b39557227d2d" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45291 } }
I20260806 04:45:40.477900 12508 heartbeater.cc:503] Master 127.7.113.254:38399 was elected leader, sending a full tablet report...
I20260806 04:45:40.478430 12789 ts_tablet_manager.cc:1428] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260806 04:45:40.478230 12790 raft_consensus.cc:348] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39081 } } peers { permanent_uuid: "31abbb9fadd74253b44646921c21765f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 38115 } } peers { permanent_uuid: "c000dcf28d9e452aa966b39557227d2d" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45291 } }
I20260806 04:45:40.478739 12790 raft_consensus.cc:374] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:40.478858 12790 raft_consensus.cc:729] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c000dcf28d9e452aa966b39557227d2d, State: Initialized, Role: FOLLOWER
I20260806 04:45:40.480041 12771 heartbeater.cc:503] Master 127.7.113.254:38399 was elected leader, sending a full tablet report...
I20260806 04:45:40.479414 12790 consensus_queue.cc:260] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39081 } } peers { permanent_uuid: "31abbb9fadd74253b44646921c21765f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 38115 } } peers { permanent_uuid: "c000dcf28d9e452aa966b39557227d2d" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45291 } }
I20260806 04:45:40.480615 12791 ts_tablet_manager.cc:1428] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260806 04:45:40.482643 12640 heartbeater.cc:503] Master 127.7.113.254:38399 was elected leader, sending a full tablet report...
I20260806 04:45:40.483500 12790 ts_tablet_manager.cc:1428] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d: Time spent starting tablet: real 0.016s user 0.009s sys 0.005s
I20260806 04:45:40.485457 12796 raft_consensus.cc:482] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:40.485772 12796 raft_consensus.cc:504] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39081 } } peers { permanent_uuid: "31abbb9fadd74253b44646921c21765f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 38115 } } peers { permanent_uuid: "c000dcf28d9e452aa966b39557227d2d" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45291 } }
I20260806 04:45:40.487567 12796 leader_election.cc:288] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31abbb9fadd74253b44646921c21765f (127.7.113.195:38115), c000dcf28d9e452aa966b39557227d2d (127.7.113.194:45291)
I20260806 04:45:40.490912 12787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.488118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:38375 (local address 127.7.113.195:38115)
0806 04:45:40.488325 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:40.488332 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:40.488864 (+ 532us) server_negotiation.cc:407] Connection header received
0806 04:45:40.489080 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:40.489086 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:40.489160 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:40.489254 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:40.490219 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:40.490226 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:40.490234 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:40.490257 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:40.490299 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:40.490351 (+ 52us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:40.490467 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:40.490575 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 04:45:40.490640 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 04:45:40.491138 12798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.487728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:38115 (local address 127.7.113.193:38375)
0806 04:45:40.488751 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:40.488769 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:40.488918 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:40.489279 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:40.489283 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:40.489309 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:40.489988 (+ 679us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:45:40.489990 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:40.490004 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:45:40.490040 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:40.490459 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:40.490467 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:40.490475 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 04:45:40.490651 (+ 176us) client_negotiation.cc:240] Negotiation successful
0806 04:45:40.490708 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":889,"thread_start_us":979,"threads_started":1}
I20260806 04:45:40.491528 12788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.488338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:37131 (local address 127.7.113.194:45291)
0806 04:45:40.488497 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:40.488503 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:40.489293 (+ 790us) server_negotiation.cc:407] Connection header received
0806 04:45:40.489515 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:40.489520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:40.489567 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:40.489679 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:40.490897 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:40.490902 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:40.490906 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:40.490925 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:40.490962 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:40.490977 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:40.491096 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:40.491305 (+ 209us) server_negotiation.cc:299] Negotiation successful
0806 04:45:40.491361 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 04:45:40.492161 12799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.488473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:45291 (local address 127.7.113.193:37131)
0806 04:45:40.489182 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:40.489200 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:40.489382 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:40.489985 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:40.489988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:40.490006 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:40.490690 (+ 684us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:45:40.490693 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:40.490709 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:45:40.490754 (+ 45us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:40.491159 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:40.491165 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:40.491170 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 04:45:40.491751 (+ 581us) client_negotiation.cc:240] Negotiation successful
0806 04:45:40.491817 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":558,"threads_started":1}
I20260806 04:45:40.492395 12725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20129cea4754009aa4c014aad0ea616" candidate_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31abbb9fadd74253b44646921c21765f" is_pre_election: true
I20260806 04:45:40.492868 12725 raft_consensus.cc:2454] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66435b66dd5d4227b6dee2e81d50b8c2 in term 0.
I20260806 04:45:40.493006 12595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20129cea4754009aa4c014aad0ea616" candidate_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c000dcf28d9e452aa966b39557227d2d" is_pre_election: true
I20260806 04:45:40.493468 12595 raft_consensus.cc:2454] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66435b66dd5d4227b6dee2e81d50b8c2 in term 0.
I20260806 04:45:40.493522 12398 leader_election.cc:302] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31abbb9fadd74253b44646921c21765f, 66435b66dd5d4227b6dee2e81d50b8c2; no voters:
I20260806 04:45:40.493916 12796 raft_consensus.cc:2781] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:45:40.494086 12796 raft_consensus.cc:482] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:45:40.494200 12796 raft_consensus.cc:3037] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:40.496485 12796 raft_consensus.cc:504] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39081 } } peers { permanent_uuid: "31abbb9fadd74253b44646921c21765f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 38115 } } peers { permanent_uuid: "c000dcf28d9e452aa966b39557227d2d" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45291 } }
I20260806 04:45:40.497192 12796 leader_election.cc:288] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [CANDIDATE]: Term 1 election: Requested vote from peers 31abbb9fadd74253b44646921c21765f (127.7.113.195:38115), c000dcf28d9e452aa966b39557227d2d (127.7.113.194:45291)
I20260806 04:45:40.497534 12725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20129cea4754009aa4c014aad0ea616" candidate_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31abbb9fadd74253b44646921c21765f"
I20260806 04:45:40.497715 12725 raft_consensus.cc:3037] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:40.497670 12595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20129cea4754009aa4c014aad0ea616" candidate_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c000dcf28d9e452aa966b39557227d2d"
I20260806 04:45:40.497908 12595 raft_consensus.cc:3037] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:40.499928 12725 raft_consensus.cc:2454] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66435b66dd5d4227b6dee2e81d50b8c2 in term 1.
I20260806 04:45:40.500116 12595 raft_consensus.cc:2454] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66435b66dd5d4227b6dee2e81d50b8c2 in term 1.
I20260806 04:45:40.500324 12398 leader_election.cc:302] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31abbb9fadd74253b44646921c21765f, 66435b66dd5d4227b6dee2e81d50b8c2; no voters:
I20260806 04:45:40.500607 12796 raft_consensus.cc:2781] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:40.501035 12796 raft_consensus.cc:686] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [term 1 LEADER]: Becoming Leader. State: Replica: 66435b66dd5d4227b6dee2e81d50b8c2, State: Running, Role: LEADER
I20260806 04:45:40.501591 12796 consensus_queue.cc:237] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39081 } } peers { permanent_uuid: "31abbb9fadd74253b44646921c21765f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 38115 } } peers { permanent_uuid: "c000dcf28d9e452aa966b39557227d2d" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45291 } }
W20260806 04:45:40.505225 12509 tablet.cc:2369] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:45:40.506873 12318 catalog_manager.cc:5495] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66435b66dd5d4227b6dee2e81d50b8c2 (127.7.113.193). New cstate: current_term: 1 leader_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66435b66dd5d4227b6dee2e81d50b8c2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31abbb9fadd74253b44646921c21765f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 38115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c000dcf28d9e452aa966b39557227d2d" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45291 } health_report { overall_health: UNKNOWN } } }
I20260806 04:45:40.524614 12784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.520785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59892 (local address 127.7.113.193:39081)
0806 04:45:40.520943 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:40.520947 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:40.521803 (+ 856us) server_negotiation.cc:407] Connection header received
0806 04:45:40.522044 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:40.522048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:40.522152 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:40.522271 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:40.523890 (+ 1619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:40.523897 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:40.523902 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:40.523920 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:40.523975 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:40.523990 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:40.524120 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:40.524227 (+ 107us) server_negotiation.cc:299] Negotiation successful
0806 04:45:40.524311 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 04:45:40.532732 12725 raft_consensus.cc:1261] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f [term 1 FOLLOWER]: Refusing update from remote peer 66435b66dd5d4227b6dee2e81d50b8c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:40.532738 12595 raft_consensus.cc:1261] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d [term 1 FOLLOWER]: Refusing update from remote peer 66435b66dd5d4227b6dee2e81d50b8c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:40.533680 12796 consensus_queue.cc:1035] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31abbb9fadd74253b44646921c21765f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:40.533990 12800 consensus_queue.cc:1035] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c000dcf28d9e452aa966b39557227d2d" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 45291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:40.545920 12804 mvcc.cc:205] Tried to move back new op lower bound from 7315421350013091840 to 7315421349898895360. Current Snapshot: MvccSnapshot[applied={T|T < 7315421350013091840}]
I20260806 04:45:40.559126 12319 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:40.559475 12319 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:40.563308 12319 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1920be416ed040b5b81a190e525318b3: Sending DeleteTablet for 3 replicas of tablet a20129cea4754009aa4c014aad0ea616
I20260806 04:45:40.564460 12442 tablet_service.cc:1514] Processing DeleteTablet for tablet a20129cea4754009aa4c014aad0ea616 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:40 UTC) from {username='slave'} at 127.0.0.1:59880
I20260806 04:45:40.564455 12705 tablet_service.cc:1514] Processing DeleteTablet for tablet a20129cea4754009aa4c014aad0ea616 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:40 UTC) from {username='slave'} at 127.0.0.1:60170
I20260806 04:45:40.564594 12574 tablet_service.cc:1514] Processing DeleteTablet for tablet a20129cea4754009aa4c014aad0ea616 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:40 UTC) from {username='slave'} at 127.0.0.1:48340
I20260806 04:45:40.567749 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 12380
I20260806 04:45:40.575336 12815 tablet_replica.cc:330] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d: stopping tablet replica
I20260806 04:45:40.575802 12815 raft_consensus.cc:2229] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:40.576381 12815 raft_consensus.cc:2258] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:40.578742 12815 ts_tablet_manager.cc:1905] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:40.579346 12814 tablet_replica.cc:330] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2: stopping tablet replica
I20260806 04:45:40.579789 12814 raft_consensus.cc:2229] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:45:40.581543 12784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.571562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59902 (local address 127.7.113.193:39081)
0806 04:45:40.571779 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:40.571785 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:40.576698 (+ 4913us) server_negotiation.cc:407] Connection header received
0806 04:45:40.576943 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:40.576952 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:40.577036 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:40.577166 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:40.580468 (+ 3302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:40.580477 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:40.580485 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:40.580511 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:40.580560 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:40.580582 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:40.580703 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:40.581015 (+ 312us) server_negotiation.cc:299] Negotiation successful
0806 04:45:40.581095 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 04:45:40.585525 12503 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:40.586730 12813 tablet_replica.cc:330] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f: stopping tablet replica
I20260806 04:45:40.587041 12815 ts_tablet_manager.cc:1918] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:45:40.587215 12815 log.cc:1196] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/a20129cea4754009aa4c014aad0ea616
I20260806 04:45:40.587235 12813 raft_consensus.cc:2229] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:40.587790 12813 raft_consensus.cc:2258] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:40.587841 12815 ts_tablet_manager.cc:1939] T a20129cea4754009aa4c014aad0ea616 P c000dcf28d9e452aa966b39557227d2d: Deleting consensus metadata
I20260806 04:45:40.589674 12304 catalog_manager.cc:4841] TS c000dcf28d9e452aa966b39557227d2d (127.7.113.194:45291): tablet a20129cea4754009aa4c014aad0ea616 (table test-table [id=d672d15f9a174b39a9fcf8d40213a7b9]) successfully deleted
I20260806 04:45:40.590880 12813 ts_tablet_manager.cc:1905] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:40.596041 12813 ts_tablet_manager.cc:1918] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:45:40.596215 12813 log.cc:1196] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/a20129cea4754009aa4c014aad0ea616
I20260806 04:45:40.596695 12813 ts_tablet_manager.cc:1939] T a20129cea4754009aa4c014aad0ea616 P 31abbb9fadd74253b44646921c21765f: Deleting consensus metadata
I20260806 04:45:40.598119 12307 catalog_manager.cc:4841] TS 31abbb9fadd74253b44646921c21765f (127.7.113.195:38115): tablet a20129cea4754009aa4c014aad0ea616 (table test-table [id=d672d15f9a174b39a9fcf8d40213a7b9]) successfully deleted
I20260806 04:45:40.681468 12814 raft_consensus.cc:2258] T a20129cea4754009aa4c014aad0ea616 P 66435b66dd5d4227b6dee2e81d50b8c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:40.682091 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 12380
W20260806 04:45:40.701491 12305 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.113.193:39081 (error 108)
I20260806 04:45:40.701732 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 12512
I20260806 04:45:40.703562 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.703126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39081 (local address 127.0.0.1:51616)
0806 04:45:40.703296 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:40.703426 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 04:45:40.703794 12305 catalog_manager.cc:4584] TS 66435b66dd5d4227b6dee2e81d50b8c2 (127.7.113.193:39081): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a20129cea4754009aa4c014aad0ea616: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39081: connect: Connection refused (error 111)
I20260806 04:45:40.704824 12788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.702656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46994 (local address 127.7.113.194:45291)
0806 04:45:40.702839 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:40.702846 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:40.702897 (+ 51us) server_negotiation.cc:407] Connection header received
0806 04:45:40.703117 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:40.703122 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:40.703217 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:40.703332 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:40.704310 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:40.704316 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:40.704320 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:40.704340 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:40.704384 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:40.704395 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:40.704494 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:40.704575 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 04:45:40.704620 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 04:45:40.705439 12635 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:40.757579 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.757098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39081 (local address 127.0.0.1:51628)
0806 04:45:40.757319 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:40.757420 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260806 04:45:40.758646 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.758288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39081 (local address 127.0.0.1:51642)
0806 04:45:40.758449 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:40.758526 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260806 04:45:40.791750 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 12512
I20260806 04:45:40.812018 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 12643
I20260806 04:45:40.814970 12787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.812779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41108 (local address 127.7.113.195:38115)
0806 04:45:40.812969 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:40.812977 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:40.813002 (+ 25us) server_negotiation.cc:407] Connection header received
0806 04:45:40.813226 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:40.813232 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:40.813332 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:40.813442 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:40.814312 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:40.814318 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:40.814323 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:40.814340 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:40.814380 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:40.814392 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:40.814526 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:40.814607 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 04:45:40.814670 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 04:45:40.815590 12766 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:40.819028 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.818548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39081 (local address 127.0.0.1:51646)
0806 04:45:40.818722 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:40.818850 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260806 04:45:40.819923 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.819593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39081 (local address 127.0.0.1:51658)
0806 04:45:40.819734 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:40.819812 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260806 04:45:40.900739 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.900230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39081 (local address 127.0.0.1:51666)
0806 04:45:40.900472 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:40.900575 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260806 04:45:40.901930 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:40.901546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39081 (local address 127.0.0.1:51678)
0806 04:45:40.901742 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:40.901809 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260806 04:45:40.904418 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 12643
I20260806 04:45:40.922544 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 12288
I20260806 04:45:40.923786 12350 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:41.029990 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 12288
2026-08-06T04:45:41Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2559 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260806 04:45:41.073447 7623 mini_oidc.cc:152] Starting JWKS server
I20260806 04:45:41.076401 7623 webserver.cc:460] Webserver started at https://127.0.0.1:33481/ using document root <none> and password file <none>
I20260806 04:45:41.076701 7623 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 04:45:41.077355 7623 webserver.cc:460] Webserver started at http://127.0.0.1:42087/ using document root <none> and password file <none>
2026-08-06T04:45:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:41Z Disabled control of system clock
I20260806 04:45:41.109915 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:40565
--webserver_interface=127.7.113.254
--webserver_port=0
--builtin_ntp_servers=127.7.113.212:44273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:40565
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33481/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/testchainca.cert with env {}
W20260806 04:45:41.433071 12827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:41.433398 12827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:41.433552 12827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:41.440771 12827 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:41.440908 12827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:41.441001 12827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:41.441129 12827 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:41.441236 12827 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 04:45:41.441325 12827 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 04:45:41.441403 12827 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33481/jwks.json
I20260806 04:45:41.451126 12827 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:44273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:40565
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:40565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33481/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:41.452395 12827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:41.453675 12827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:41.465169 12833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:41.465221 12832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:41.465294 12835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:41.466162 12827 server_base.cc:1034] running on GCE node
I20260806 04:45:41.466952 12827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:41.468375 12827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:41.469599 12827 hybrid_clock.cc:648] HybridClock initialized: now 1785991541469560 us; error 50 us; skew 500 ppm
I20260806 04:45:41.469940 12827 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:45:41.472095 12827 webserver.cc:460] Webserver started at http://127.7.113.254:40267/ using document root <none> and password file <none>
I20260806 04:45:41.472807 12827 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:41.472944 12827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:41.473256 12827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:41.476022 12827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "de6a8c4faac44761b4f0146a30c95715"
format_stamp: "Formatted at 2026-08-06 04:45:41 on dist-test-slave-0b58"
server_key: "45248c34b4b87ed99804596d57b770ab"
server_key_iv: "33be4ce253b6a67969ea1adce7920bde"
server_key_version: "encryptionkey@0"
I20260806 04:45:41.476931 12827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "de6a8c4faac44761b4f0146a30c95715"
format_stamp: "Formatted at 2026-08-06 04:45:41 on dist-test-slave-0b58"
server_key: "45248c34b4b87ed99804596d57b770ab"
server_key_iv: "33be4ce253b6a67969ea1adce7920bde"
server_key_version: "encryptionkey@0"
I20260806 04:45:41.481825 12827 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 04:45:41.485191 12841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:41.486421 12827 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:45:41.486608 12827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "de6a8c4faac44761b4f0146a30c95715"
format_stamp: "Formatted at 2026-08-06 04:45:41 on dist-test-slave-0b58"
server_key: "45248c34b4b87ed99804596d57b770ab"
server_key_iv: "33be4ce253b6a67969ea1adce7920bde"
server_key_version: "encryptionkey@0"
I20260806 04:45:41.486815 12827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:41.512521 12827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:41.513324 12827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:41.513625 12827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:41.533135 12827 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:40565
I20260806 04:45:41.533149 12893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:40565 every 8 connection(s)
I20260806 04:45:41.534471 12827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:41.538012 12894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:41.539108 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 12827
I20260806 04:45:41.539314 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:41.539984 7623 external_mini_cluster.cc:1428] Setting key 6f0ea61e9e9254f3b22e73477d9d5a81
I20260806 04:45:41.550244 12894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715: Bootstrap starting.
I20260806 04:45:41.553089 12897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:41.541931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33744 (local address 127.7.113.254:40565)
0806 04:45:41.543017 (+ 1086us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:41.543026 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:41.543065 (+ 39us) server_negotiation.cc:407] Connection header received
0806 04:45:41.544720 (+ 1655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:41.544741 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:41.545164 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:41.545509 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:41.546091 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:41.547344 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:41.548772 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:41.549427 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:41.549624 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:41.550890 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:41.550897 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:41.550910 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:41.551397 (+ 487us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:41.551474 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:41.551497 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:41.551633 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:41.551857 (+ 224us) server_negotiation.cc:299] Negotiation successful
0806 04:45:41.552138 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":663,"thread_start_us":397,"threads_started":1}
I20260806 04:45:41.553594 12894 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:41.554628 12894 log.cc:824] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:41.556783 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:45:41.557508 12894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715: No bootstrap required, opened a new log
I20260806 04:45:41.565107 12894 raft_consensus.cc:348] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6a8c4faac44761b4f0146a30c95715" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 40565 } }
I20260806 04:45:41.565469 12894 raft_consensus.cc:374] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:41.565577 12894 raft_consensus.cc:729] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de6a8c4faac44761b4f0146a30c95715, State: Initialized, Role: FOLLOWER
I20260806 04:45:41.566087 12894 consensus_queue.cc:260] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6a8c4faac44761b4f0146a30c95715" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 40565 } }
I20260806 04:45:41.566349 12894 raft_consensus.cc:388] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:41.566498 12894 raft_consensus.cc:482] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:41.566668 12894 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:41.568853 12894 raft_consensus.cc:504] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6a8c4faac44761b4f0146a30c95715" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 40565 } }
I20260806 04:45:41.569366 12894 leader_election.cc:302] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de6a8c4faac44761b4f0146a30c95715; no voters:
I20260806 04:45:41.570024 12894 leader_election.cc:288] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:41.570176 12899 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:41.570930 12899 raft_consensus.cc:686] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [term 1 LEADER]: Becoming Leader. State: Replica: de6a8c4faac44761b4f0146a30c95715, State: Running, Role: LEADER
I20260806 04:45:41.571517 12899 consensus_queue.cc:237] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6a8c4faac44761b4f0146a30c95715" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 40565 } }
I20260806 04:45:41.572052 12894 sys_catalog.cc:564] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:41.574580 12901 sys_catalog.cc:455] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [sys.catalog]: SysCatalogTable state changed. Reason: New leader de6a8c4faac44761b4f0146a30c95715. Latest consensus state: current_term: 1 leader_uuid: "de6a8c4faac44761b4f0146a30c95715" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6a8c4faac44761b4f0146a30c95715" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 40565 } } }
I20260806 04:45:41.574570 12900 sys_catalog.cc:455] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de6a8c4faac44761b4f0146a30c95715" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6a8c4faac44761b4f0146a30c95715" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 40565 } } }
I20260806 04:45:41.575085 12901 sys_catalog.cc:458] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:41.575115 12900 sys_catalog.cc:458] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:41.581658 12908 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:41.586261 12908 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:41.594074 12908 catalog_manager.cc:1347] Generated new cluster ID: a6ed7f60c2cb4f65aceb62d043a62d26
I20260806 04:45:41.594185 12908 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:41.614269 12908 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:41.616061 12908 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:41.626219 12908 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de6a8c4faac44761b4f0146a30c95715: Generated new TSK 0
I20260806 04:45:41.627018 12908 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 04:45:41.669879 12924 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260806 04:45:41.670104 12924 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 04:45:41.672447 12897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:41.650113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33758 (local address 127.7.113.254:40565)
0806 04:45:41.650316 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:41.650324 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:41.650807 (+ 483us) server_negotiation.cc:407] Connection header received
0806 04:45:41.651202 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:41.651206 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:41.651284 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:41.651437 (+ 153us) server_negotiation.cc:226] Negotiated authn=JWT
0806 04:45:41.651974 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:41.652760 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:41.654222 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:41.654704 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:41.654870 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:41.655411 (+ 541us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 04:45:41.671663 (+ 16252us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33481/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 04:45:41.672085 (+ 422us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33758: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33481/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":58}
W20260806 04:45:41.672643 12897 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33758: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33481/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260806 04:45:41.674117 12923 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:45:41.650062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:40565 (local address 127.0.0.1:33758)
0806 04:45:41.650692 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:41.650707 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:41.650906 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:41.651470 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:41.651475 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:41.651489 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0806 04:45:41.651829 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:41.651837 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:41.652912 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:41.652925 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:41.654077 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:41.654088 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:41.654935 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:41.654944 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:41.655076 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:41.655132 (+ 56us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 04:45:41.671955 (+ 16823us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33481/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 04:45:41.672335 (+ 380us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.113.254:40565: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33481/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":339,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.7.113.254:40565: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33481/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260806 04:45:41.676226 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 12827
I20260806 04:45:41.677386 12889 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:41.771440 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 12827
2026-08-06T04:45:41Z chronyd exiting
I20260806 04:45:41.823554 7623 test_util.cc:175] -----------------------------------------------
I20260806 04:45:41.823674 7623 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785991498713577-7623-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (755 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260806 04:45:41.828322 7623 mini_oidc.cc:152] Starting JWKS server
I20260806 04:45:41.830088 7623 webserver.cc:460] Webserver started at https://127.0.0.1:37669/ using document root <none> and password file <none>
I20260806 04:45:41.830279 7623 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 04:45:41.830835 7623 webserver.cc:460] Webserver started at http://127.0.0.1:43577/ using document root <none> and password file <none>
2026-08-06T04:45:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:41Z Disabled control of system clock
I20260806 04:45:41.862617 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:37593
--webserver_interface=127.7.113.254
--webserver_port=0
--builtin_ntp_servers=127.7.113.212:40865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:37593
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37669/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/testchainca.cert with env {}
W20260806 04:45:42.184979 12931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:42.185317 12931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:42.185477 12931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:42.192548 12931 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:42.192687 12931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:42.192770 12931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:42.192878 12931 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:42.192970 12931 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 04:45:42.193073 12931 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 04:45:42.193140 12931 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37669/jwks.json
I20260806 04:45:42.202837 12931 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:40865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:37593
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:37593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37669/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:42.204098 12931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:42.205448 12931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:42.217149 12939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:42.217268 12937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:42.217252 12936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:42.218231 12931 server_base.cc:1034] running on GCE node
I20260806 04:45:42.219015 12931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:42.220391 12931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:42.221590 12931 hybrid_clock.cc:648] HybridClock initialized: now 1785991542221558 us; error 36 us; skew 500 ppm
I20260806 04:45:42.221931 12931 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:45:42.224921 12931 webserver.cc:460] Webserver started at http://127.7.113.254:45883/ using document root <none> and password file <none>
I20260806 04:45:42.225872 12931 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:42.226003 12931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:42.226423 12931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:42.230397 12931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "ad2489b26c844c458f0fa56ec673d0f0"
format_stamp: "Formatted at 2026-08-06 04:45:42 on dist-test-slave-0b58"
server_key: "b9c1c77a5918bb17af6dad82f38456a3"
server_key_iv: "dd9ea57c9c433a785d677e2be5be05b0"
server_key_version: "encryptionkey@0"
I20260806 04:45:42.231472 12931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "ad2489b26c844c458f0fa56ec673d0f0"
format_stamp: "Formatted at 2026-08-06 04:45:42 on dist-test-slave-0b58"
server_key: "b9c1c77a5918bb17af6dad82f38456a3"
server_key_iv: "dd9ea57c9c433a785d677e2be5be05b0"
server_key_version: "encryptionkey@0"
I20260806 04:45:42.236657 12931 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260806 04:45:42.239907 12945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:42.241209 12931 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:45:42.241389 12931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "ad2489b26c844c458f0fa56ec673d0f0"
format_stamp: "Formatted at 2026-08-06 04:45:42 on dist-test-slave-0b58"
server_key: "b9c1c77a5918bb17af6dad82f38456a3"
server_key_iv: "dd9ea57c9c433a785d677e2be5be05b0"
server_key_version: "encryptionkey@0"
I20260806 04:45:42.241591 12931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:42.258872 12931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:42.259647 12931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:42.259944 12931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:42.278234 12931 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:37593
I20260806 04:45:42.278241 12996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:37593 every 8 connection(s)
I20260806 04:45:42.279572 12931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:42.281316 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 12931
I20260806 04:45:42.281517 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:42.282232 7623 external_mini_cluster.cc:1428] Setting key 93ebed507332913d854787a8d9ae7c89
I20260806 04:45:42.283610 12997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:42.297394 13000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:42.284100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35714 (local address 127.7.113.254:37593)
0806 04:45:42.285406 (+ 1306us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:42.285421 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:42.285471 (+ 50us) server_negotiation.cc:407] Connection header received
0806 04:45:42.287252 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:42.287279 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:42.287882 (+ 603us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:42.288384 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:42.288898 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:42.290952 (+ 2054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:42.292300 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:42.293369 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:42.293558 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:42.294616 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:42.294630 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:42.294648 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:42.295399 (+ 751us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:42.295489 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:42.295516 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:42.295639 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:42.295798 (+ 159us) server_negotiation.cc:299] Negotiation successful
0806 04:45:42.296142 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":816,"thread_start_us":610,"threads_started":1}
I20260806 04:45:42.298489 12997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0: Bootstrap starting.
I20260806 04:45:42.301119 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:45:42.302064 12997 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:42.303234 12997 log.cc:824] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:42.306264 12997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0: No bootstrap required, opened a new log
I20260806 04:45:42.313561 12997 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad2489b26c844c458f0fa56ec673d0f0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37593 } }
I20260806 04:45:42.313882 12997 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:42.313963 12997 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2489b26c844c458f0fa56ec673d0f0, State: Initialized, Role: FOLLOWER
I20260806 04:45:42.314497 12997 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad2489b26c844c458f0fa56ec673d0f0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37593 } }
I20260806 04:45:42.314689 12997 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:42.314785 12997 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:42.314949 12997 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:42.317049 12997 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad2489b26c844c458f0fa56ec673d0f0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37593 } }
I20260806 04:45:42.317482 12997 leader_election.cc:302] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad2489b26c844c458f0fa56ec673d0f0; no voters:
I20260806 04:45:42.317970 12997 leader_election.cc:288] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:42.318143 13002 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:42.318864 13002 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [term 1 LEADER]: Becoming Leader. State: Replica: ad2489b26c844c458f0fa56ec673d0f0, State: Running, Role: LEADER
I20260806 04:45:42.319355 13002 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad2489b26c844c458f0fa56ec673d0f0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37593 } }
I20260806 04:45:42.319957 12997 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:42.322320 13004 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad2489b26c844c458f0fa56ec673d0f0. Latest consensus state: current_term: 1 leader_uuid: "ad2489b26c844c458f0fa56ec673d0f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad2489b26c844c458f0fa56ec673d0f0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37593 } } }
I20260806 04:45:42.322651 13004 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:42.322429 13003 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad2489b26c844c458f0fa56ec673d0f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad2489b26c844c458f0fa56ec673d0f0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37593 } } }
I20260806 04:45:42.322842 13003 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:42.323510 13010 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:42.330080 13010 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:42.338732 13010 catalog_manager.cc:1347] Generated new cluster ID: 0eb810a0383a4adcac7057f1f6425916
I20260806 04:45:42.338860 13010 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:42.358767 13010 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:42.359915 13010 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:42.370782 13010 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad2489b26c844c458f0fa56ec673d0f0: Generated new TSK 0
I20260806 04:45:42.371526 13010 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 04:45:42.410384 13027 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260806 04:45:42.410518 13027 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 04:45:42.411816 13000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:42.392130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35728 (local address 127.7.113.254:37593)
0806 04:45:42.392336 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:42.392343 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:42.392728 (+ 385us) server_negotiation.cc:407] Connection header received
0806 04:45:42.392927 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:42.392933 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:42.393018 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:42.393178 (+ 160us) server_negotiation.cc:226] Negotiated authn=JWT
0806 04:45:42.393586 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:42.394696 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:42.396037 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:42.396738 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:42.396873 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:42.397330 (+ 457us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 04:45:42.411084 (+ 13754us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37669/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 04:45:42.411473 (+ 389us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35728: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37669/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":62}
W20260806 04:45:42.411931 13026 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:45:42.392014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:37593 (local address 127.0.0.1:35728)
0806 04:45:42.392630 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:42.392645 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:42.392753 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:42.393190 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:42.393194 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:42.393203 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0806 04:45:42.393434 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:42.393441 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:42.394834 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:42.394838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:42.395906 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:42.395917 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:42.396917 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:42.396922 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:42.397050 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:42.397091 (+ 41us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 04:45:42.411313 (+ 14222us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37669/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 04:45:42.411556 (+ 243us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.113.254:37593: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37669/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":361,"threads_started":1}
W20260806 04:45:42.411943 13000 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35728: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37669/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260806 04:45:42.413060 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 12931
I20260806 04:45:42.414227 12992 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:42.507114 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 12931
2026-08-06T04:45:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (733 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260806 04:45:42.560997 7623 mini_oidc.cc:152] Starting JWKS server
I20260806 04:45:42.562918 7623 webserver.cc:460] Webserver started at https://127.0.0.1:42087/ using document root <none> and password file <none>
I20260806 04:45:42.563187 7623 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 04:45:42.563863 7623 webserver.cc:460] Webserver started at http://127.0.0.1:46399/ using document root <none> and password file <none>
2026-08-06T04:45:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:42Z Disabled control of system clock
I20260806 04:45:42.595410 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:43947
--webserver_interface=127.7.113.254
--webserver_port=0
--builtin_ntp_servers=127.7.113.212:42631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:43947
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42087/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 04:45:42.914641 13034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:42.914969 13034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:42.915132 13034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:42.922291 13034 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:42.922456 13034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:42.922552 13034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:42.922657 13034 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:42.922746 13034 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 04:45:42.922839 13034 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 04:45:42.922901 13034 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42087/jwks.json
I20260806 04:45:42.932016 13034 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:42631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:43947
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:43947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42087/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:42.933385 13034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:42.935210 13034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:42.946939 13040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:42.946986 13042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:42.947109 13039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:42.948150 13034 server_base.cc:1034] running on GCE node
I20260806 04:45:42.948972 13034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:42.950273 13034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:42.951500 13034 hybrid_clock.cc:648] HybridClock initialized: now 1785991542951471 us; error 41 us; skew 500 ppm
I20260806 04:45:42.951835 13034 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:45:42.954007 13034 webserver.cc:460] Webserver started at http://127.7.113.254:39091/ using document root <none> and password file <none>
I20260806 04:45:42.954691 13034 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:42.954825 13034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:42.955193 13034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:42.958001 13034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "b59aadcc142f4ddfa995dc9b37e1dedd"
format_stamp: "Formatted at 2026-08-06 04:45:42 on dist-test-slave-0b58"
server_key: "01a7163eb5b64a127c54020a91b1489f"
server_key_iv: "757d53d37918669bce9778e4c3a02bcc"
server_key_version: "encryptionkey@0"
I20260806 04:45:42.958794 13034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "b59aadcc142f4ddfa995dc9b37e1dedd"
format_stamp: "Formatted at 2026-08-06 04:45:42 on dist-test-slave-0b58"
server_key: "01a7163eb5b64a127c54020a91b1489f"
server_key_iv: "757d53d37918669bce9778e4c3a02bcc"
server_key_version: "encryptionkey@0"
I20260806 04:45:42.963647 13034 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260806 04:45:42.967057 13048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:42.968327 13034 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 04:45:42.968508 13034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "b59aadcc142f4ddfa995dc9b37e1dedd"
format_stamp: "Formatted at 2026-08-06 04:45:42 on dist-test-slave-0b58"
server_key: "01a7163eb5b64a127c54020a91b1489f"
server_key_iv: "757d53d37918669bce9778e4c3a02bcc"
server_key_version: "encryptionkey@0"
I20260806 04:45:42.968724 13034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:42.988555 13034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:42.989333 13034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:42.989643 13034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:43.007673 13034 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:43947
I20260806 04:45:43.007697 13099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:43947 every 8 connection(s)
I20260806 04:45:43.008926 13034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:43.012456 13100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:43.014590 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 13034
I20260806 04:45:43.014798 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:43.015604 7623 external_mini_cluster.cc:1428] Setting key 2b8d3c149f9c6038567e2820bb9b62b5
I20260806 04:45:43.024371 13100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd: Bootstrap starting.
I20260806 04:45:43.027863 13100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:43.028896 13103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:43.017523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47278 (local address 127.7.113.254:43947)
0806 04:45:43.018523 (+ 1000us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:43.018533 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:43.018575 (+ 42us) server_negotiation.cc:407] Connection header received
0806 04:45:43.020154 (+ 1579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:43.020173 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:43.020674 (+ 501us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:43.021014 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:43.021538 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:43.022781 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:43.024638 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:43.025276 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:43.025418 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:43.026660 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:43.026666 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:43.026678 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:43.027180 (+ 502us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:43.027263 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:43.027283 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:43.027365 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:43.027598 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 04:45:43.027957 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":384,"threads_started":1}
I20260806 04:45:43.028927 13100 log.cc:824] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:43.032114 13100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd: No bootstrap required, opened a new log
I20260806 04:45:43.033063 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:45:43.040557 13100 raft_consensus.cc:348] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b59aadcc142f4ddfa995dc9b37e1dedd" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43947 } }
I20260806 04:45:43.040865 13100 raft_consensus.cc:374] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:43.040938 13100 raft_consensus.cc:729] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b59aadcc142f4ddfa995dc9b37e1dedd, State: Initialized, Role: FOLLOWER
I20260806 04:45:43.041373 13100 consensus_queue.cc:260] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b59aadcc142f4ddfa995dc9b37e1dedd" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43947 } }
I20260806 04:45:43.041564 13100 raft_consensus.cc:388] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:43.041654 13100 raft_consensus.cc:482] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:43.041771 13100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:43.043685 13100 raft_consensus.cc:504] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b59aadcc142f4ddfa995dc9b37e1dedd" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43947 } }
I20260806 04:45:43.044103 13100 leader_election.cc:302] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b59aadcc142f4ddfa995dc9b37e1dedd; no voters:
I20260806 04:45:43.044914 13100 leader_election.cc:288] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:43.045019 13105 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:43.045764 13105 raft_consensus.cc:686] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [term 1 LEADER]: Becoming Leader. State: Replica: b59aadcc142f4ddfa995dc9b37e1dedd, State: Running, Role: LEADER
I20260806 04:45:43.046329 13105 consensus_queue.cc:237] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b59aadcc142f4ddfa995dc9b37e1dedd" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43947 } }
I20260806 04:45:43.046828 13100 sys_catalog.cc:564] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:43.049173 13106 sys_catalog.cc:455] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b59aadcc142f4ddfa995dc9b37e1dedd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b59aadcc142f4ddfa995dc9b37e1dedd" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43947 } } }
I20260806 04:45:43.049551 13106 sys_catalog.cc:458] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:43.049275 13107 sys_catalog.cc:455] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b59aadcc142f4ddfa995dc9b37e1dedd. Latest consensus state: current_term: 1 leader_uuid: "b59aadcc142f4ddfa995dc9b37e1dedd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b59aadcc142f4ddfa995dc9b37e1dedd" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43947 } } }
I20260806 04:45:43.049708 13107 sys_catalog.cc:458] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:43.052343 13114 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:43.057291 13114 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:43.065907 13114 catalog_manager.cc:1347] Generated new cluster ID: bfd42212b9f54d9cb4ccbeee127caa4c
I20260806 04:45:43.066027 13114 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:43.081401 13114 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:43.082549 13114 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:43.089422 13114 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b59aadcc142f4ddfa995dc9b37e1dedd: Generated new TSK 0
I20260806 04:45:43.090171 13114 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:45:43.114108 13103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:43.105706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47290 (local address 127.7.113.254:43947)
0806 04:45:43.105875 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:43.105879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:43.106315 (+ 436us) server_negotiation.cc:407] Connection header received
0806 04:45:43.106515 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:43.106521 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:43.106609 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:43.106779 (+ 170us) server_negotiation.cc:226] Negotiated authn=JWT
0806 04:45:43.107280 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:43.108456 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:43.109777 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:43.110500 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:43.110641 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:43.111091 (+ 450us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 04:45:43.113460 (+ 2369us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42087/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 04:45:43.113795 (+ 335us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47290: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42087/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":39}
W20260806 04:45:43.114239 13103 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47290: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42087/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260806 04:45:43.115897 13129 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:45:43.105592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:43947 (local address 127.0.0.1:47290)
0806 04:45:43.106209 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:43.106226 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:43.106349 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:43.106791 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:43.106795 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:43.106804 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0806 04:45:43.107074 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:43.107087 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:43.108587 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:43.108591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:43.109628 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:43.109639 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:43.110677 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:43.110681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:43.110808 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:43.110838 (+ 30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 04:45:43.113662 (+ 2824us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42087/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 04:45:43.115494 (+ 1832us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.113.254:43947: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42087/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":480,"mutex_wait_us":1507,"thread_start_us":321,"threads_started":1}
I20260806 04:45:43.117064 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 13034
I20260806 04:45:43.118440 13095 generic_service.cc:196] Checking for leaks (request via RPC)
E20260806 04:45:43.126935 13130 webserver.cc:533] Webserver: sslize failed:
E20260806 04:45:43.127018 13130 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 04:45:43.209817 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 13034
2026-08-06T04:45:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (705 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-06T04:45:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:43Z Disabled control of system clock
I20260806 04:45:43.298537 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:44513
--webserver_interface=127.7.113.254
--webserver_port=0
--builtin_ntp_servers=127.7.113.212:34059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:44513
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/testchainca.cert with env {}
W20260806 04:45:43.616031 13135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:43.616343 13135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:43.616438 13135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:43.623243 13135 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:43.623350 13135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:43.623389 13135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:43.623440 13135 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:43.623476 13135 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 04:45:43.623538 13135 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 04:45:43.623579 13135 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260806 04:45:43.632965 13135 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:34059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:44513
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:44513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:43.634088 13135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:43.635293 13135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:43.647279 13143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:43.647258 13141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:43.647409 13140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:43.647899 13135 server_base.cc:1034] running on GCE node
I20260806 04:45:43.648718 13135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:43.649981 13135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:43.651180 13135 hybrid_clock.cc:648] HybridClock initialized: now 1785991543651145 us; error 35 us; skew 500 ppm
I20260806 04:45:43.651490 13135 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:45:43.653626 13135 webserver.cc:460] Webserver started at http://127.7.113.254:44135/ using document root <none> and password file <none>
I20260806 04:45:43.654266 13135 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:43.654364 13135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:43.654621 13135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:43.657482 13135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "0a37cb571eec45d5b57a93f1c7de616e"
format_stamp: "Formatted at 2026-08-06 04:45:43 on dist-test-slave-0b58"
server_key: "ae78eb2b0b5c7db4ec5f6bd94338a753"
server_key_iv: "dd8bfb0e736b23926bcb23b82453c60a"
server_key_version: "encryptionkey@0"
I20260806 04:45:43.658221 13135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "0a37cb571eec45d5b57a93f1c7de616e"
format_stamp: "Formatted at 2026-08-06 04:45:43 on dist-test-slave-0b58"
server_key: "ae78eb2b0b5c7db4ec5f6bd94338a753"
server_key_iv: "dd8bfb0e736b23926bcb23b82453c60a"
server_key_version: "encryptionkey@0"
I20260806 04:45:43.663158 13135 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 04:45:43.666497 13149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:43.667893 13135 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 04:45:43.668030 13135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "0a37cb571eec45d5b57a93f1c7de616e"
format_stamp: "Formatted at 2026-08-06 04:45:43 on dist-test-slave-0b58"
server_key: "ae78eb2b0b5c7db4ec5f6bd94338a753"
server_key_iv: "dd8bfb0e736b23926bcb23b82453c60a"
server_key_version: "encryptionkey@0"
I20260806 04:45:43.668195 13135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:43.683045 13135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:43.683746 13135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:43.684003 13135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:43.702512 13135 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:44513
I20260806 04:45:43.702534 13201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:44513 every 8 connection(s)
I20260806 04:45:43.703799 13135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:43.707248 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 13135
I20260806 04:45:43.707496 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:43.707540 13202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:43.708164 7623 external_mini_cluster.cc:1428] Setting key 8452c1012176579ec67541f369128d79
I20260806 04:45:43.719921 13202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e: Bootstrap starting.
I20260806 04:45:43.720975 13205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:43.710090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39950 (local address 127.7.113.254:44513)
0806 04:45:43.711020 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:43.711029 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:43.711068 (+ 39us) server_negotiation.cc:407] Connection header received
0806 04:45:43.712621 (+ 1553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:43.712644 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:43.713064 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:43.713446 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:43.713993 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:43.715243 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:43.716677 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:43.717358 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:43.717565 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:43.718752 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:43.718759 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:43.718771 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:45:43.719254 (+ 483us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:43.719332 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:45:43.719352 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:43.719473 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:43.719706 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 04:45:43.720028 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":328,"threads_started":1}
I20260806 04:45:43.723116 13202 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:43.724207 13202 log.cc:824] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:43.724495 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:45:43.727093 13202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e: No bootstrap required, opened a new log
I20260806 04:45:43.734838 13202 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a37cb571eec45d5b57a93f1c7de616e" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44513 } }
I20260806 04:45:43.735193 13202 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:43.735308 13202 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a37cb571eec45d5b57a93f1c7de616e, State: Initialized, Role: FOLLOWER
I20260806 04:45:43.735848 13202 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a37cb571eec45d5b57a93f1c7de616e" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44513 } }
I20260806 04:45:43.736083 13202 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:43.736227 13202 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:43.736481 13202 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:43.738834 13202 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a37cb571eec45d5b57a93f1c7de616e" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44513 } }
I20260806 04:45:43.739428 13202 leader_election.cc:302] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a37cb571eec45d5b57a93f1c7de616e; no voters:
I20260806 04:45:43.739984 13202 leader_election.cc:288] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:43.740144 13207 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:43.741034 13207 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [term 1 LEADER]: Becoming Leader. State: Replica: 0a37cb571eec45d5b57a93f1c7de616e, State: Running, Role: LEADER
I20260806 04:45:43.741532 13207 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a37cb571eec45d5b57a93f1c7de616e" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44513 } }
I20260806 04:45:43.742169 13202 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:43.744112 13208 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a37cb571eec45d5b57a93f1c7de616e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a37cb571eec45d5b57a93f1c7de616e" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44513 } } }
I20260806 04:45:43.744340 13209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a37cb571eec45d5b57a93f1c7de616e. Latest consensus state: current_term: 1 leader_uuid: "0a37cb571eec45d5b57a93f1c7de616e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a37cb571eec45d5b57a93f1c7de616e" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44513 } } }
I20260806 04:45:43.744577 13208 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:43.744652 13209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:43.745543 13212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:43.751080 13212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:43.759150 13212 catalog_manager.cc:1347] Generated new cluster ID: 1eed68025b5143dc9b6cdd63d11b6d25
I20260806 04:45:43.759265 13212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:43.774471 13212 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:43.775593 13212 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:43.780524 13212 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a37cb571eec45d5b57a93f1c7de616e: Generated new TSK 0
I20260806 04:45:43.781201 13212 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:45:43.851787 13205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:43.797168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39960 (local address 127.7.113.254:44513)
0806 04:45:43.797367 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:43.797373 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:43.797673 (+ 300us) server_negotiation.cc:407] Connection header received
0806 04:45:43.797914 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:43.797919 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:43.798005 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:43.798171 (+ 166us) server_negotiation.cc:226] Negotiated authn=JWT
0806 04:45:43.798602 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:43.799719 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:43.801201 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:43.801890 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:43.802022 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:43.802462 (+ 440us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 04:45:43.851013 (+ 48551us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 04:45:43.851452 (+ 439us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39960: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":75}
W20260806 04:45:43.851938 13205 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39960: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260806 04:45:43.851930 13231 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:45:43.797027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:44513 (local address 127.0.0.1:39960)
0806 04:45:43.797579 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:43.797594 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:43.797700 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:43.798183 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:43.798187 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:43.798196 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0806 04:45:43.798462 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:43.798469 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:43.799854 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:43.799857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:43.801063 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:43.801074 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:43.802048 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:43.802052 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:43.802178 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:43.802206 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 04:45:43.851321 (+ 49115us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 04:45:43.851565 (+ 244us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.113.254:44513: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":305,"threads_started":1}
I20260806 04:45:43.853482 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 13135
I20260806 04:45:43.854712 13197 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:43.949466 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 13135
2026-08-06T04:45:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (719 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (404 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (407 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:45:44 dist-test-slave-0b58 krb5kdc[13246](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:45:44 dist-test-slave-0b58 krb5kdc[13246](info): set up 2 sockets
Aug 06 04:45:44 dist-test-slave-0b58 krb5kdc[13246](info): commencing operation
krb5kdc: starting...
W20260806 04:45:45.851158 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:45:46 dist-test-slave-0b58 krb5kdc[13246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:45:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:45:46.083139 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:41041
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:39657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:41041
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:46.411541 13259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:46.411808 13259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:46.411998 13259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:46.419340 13259 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:46.419446 13259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:46.419493 13259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:46.419569 13259 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:46.419660 13259 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:45:46.429639 13259 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:39657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:41041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:41041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:46.431052 13259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:46.432410 13259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:46.444351 13265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:46.444429 13267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:46.444403 13264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:46.445235 13259 server_base.cc:1034] running on GCE node
I20260806 04:45:46.445986 13259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:46.447369 13259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:46.448570 13259 hybrid_clock.cc:648] HybridClock initialized: now 1785991546448512 us; error 49 us; skew 500 ppm
I20260806 04:45:46.448886 13259 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:46 dist-test-slave-0b58 krb5kdc[13246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991546, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:46.451772 13259 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:45:46.453351 13259 webserver.cc:460] Webserver started at http://127.7.113.254:38867/ using document root <none> and password file <none>
I20260806 04:45:46.454023 13259 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:46.454128 13259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:46.454422 13259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:46.457372 13259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "eb920b3c0f1845a5b57b3bc5daa6903d"
format_stamp: "Formatted at 2026-08-06 04:45:46 on dist-test-slave-0b58"
server_key: "12007828ea4b0ed05a14e26a8bd31e6c"
server_key_iv: "495ef10a61be834305f39ee98775c834"
server_key_version: "encryptionkey@0"
I20260806 04:45:46.458079 13259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "eb920b3c0f1845a5b57b3bc5daa6903d"
format_stamp: "Formatted at 2026-08-06 04:45:46 on dist-test-slave-0b58"
server_key: "12007828ea4b0ed05a14e26a8bd31e6c"
server_key_iv: "495ef10a61be834305f39ee98775c834"
server_key_version: "encryptionkey@0"
I20260806 04:45:46.463593 13259 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 04:45:46.466910 13274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:46.468169 13259 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:45:46.468387 13259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "eb920b3c0f1845a5b57b3bc5daa6903d"
format_stamp: "Formatted at 2026-08-06 04:45:46 on dist-test-slave-0b58"
server_key: "12007828ea4b0ed05a14e26a8bd31e6c"
server_key_iv: "495ef10a61be834305f39ee98775c834"
server_key_version: "encryptionkey@0"
I20260806 04:45:46.468554 13259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:46.484910 13259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:46.488590 13259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:46.488816 13259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:46.506541 13259 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:41041
I20260806 04:45:46.506608 13327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:41041 every 8 connection(s)
I20260806 04:45:46.507859 13259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:46.511339 13328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:46.516192 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 13259
I20260806 04:45:46.516498 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:46.517247 7623 external_mini_cluster.cc:1428] Setting key 382a5202c06124fa703ec840a1f93446
I20260806 04:45:46.522406 13328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d: Bootstrap starting.
I20260806 04:45:46.526067 13328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:46.527259 13328 log.cc:824] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:46.530521 13328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d: No bootstrap required, opened a new log
Aug 06 04:45:46 dist-test-slave-0b58 krb5kdc[13246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:46.540993 13328 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb920b3c0f1845a5b57b3bc5daa6903d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41041 } }
I20260806 04:45:46.541435 13328 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:46.541536 13328 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb920b3c0f1845a5b57b3bc5daa6903d, State: Initialized, Role: FOLLOWER
I20260806 04:45:46.542100 13331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:46.519225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59738 (local address 127.7.113.254:41041)
0806 04:45:46.520014 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:46.520024 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:46.520067 (+ 43us) server_negotiation.cc:407] Connection header received
0806 04:45:46.521821 (+ 1754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:46.521842 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:46.522279 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:46.522620 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:46.524447 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:46.525804 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:46.527616 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:46.528734 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:46.528858 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:46.533664 (+ 4806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:46.533675 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:46.533692 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:46.533752 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:46.537691 (+ 3939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:46.538398 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:46.538406 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:46.538415 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:46.538632 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:46.538998 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:46.539003 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:46.539007 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:46.539730 (+ 723us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:46.540018 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:46.540411 (+ 393us) server_negotiation.cc:299] Negotiation successful
0806 04:45:46.540825 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":357,"threads_started":1}
I20260806 04:45:46.542189 13328 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb920b3c0f1845a5b57b3bc5daa6903d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41041 } }
I20260806 04:45:46.542464 13328 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:46.542606 13328 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:46.542837 13328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:46.546701 13328 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb920b3c0f1845a5b57b3bc5daa6903d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41041 } }
I20260806 04:45:46.547178 13328 leader_election.cc:302] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb920b3c0f1845a5b57b3bc5daa6903d; no voters:
I20260806 04:45:46.547751 13328 leader_election.cc:288] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:46.547858 13334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:46.548619 13334 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [term 1 LEADER]: Becoming Leader. State: Replica: eb920b3c0f1845a5b57b3bc5daa6903d, State: Running, Role: LEADER
I20260806 04:45:46.549103 13334 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb920b3c0f1845a5b57b3bc5daa6903d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41041 } }
I20260806 04:45:46.549800 13328 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:46.552989 13335 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb920b3c0f1845a5b57b3bc5daa6903d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb920b3c0f1845a5b57b3bc5daa6903d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41041 } } }
I20260806 04:45:46.553669 13335 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:46.553453 13336 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb920b3c0f1845a5b57b3bc5daa6903d. Latest consensus state: current_term: 1 leader_uuid: "eb920b3c0f1845a5b57b3bc5daa6903d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb920b3c0f1845a5b57b3bc5daa6903d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41041 } } }
I20260806 04:45:46.553828 13336 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d [sys.catalog]: This master's current role is: LEADER
W20260806 04:45:46.563555 13350 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 04:45:46.563651 13350 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 04:45:46.563786 13345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:46.565970 13345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:46.573872 13345 catalog_manager.cc:1347] Generated new cluster ID: 4b31295e21e84945ba6cf76ab5620a9a
I20260806 04:45:46.573975 13345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:46.586022 13345 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:46.587208 13345 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:46.601295 13345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb920b3c0f1845a5b57b3bc5daa6903d: Generated new TSK 0
I20260806 04:45:46.602097 13345 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:45:46.659260 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41041
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:39657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:46.983307 13355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:46.983613 13355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:46.983794 13355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:46.990895 13355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:46.991036 13355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:46.991219 13355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:45:47.000811 13355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:39657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:47.002084 13355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:47.003432 13355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:47.016359 13360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:47.016395 13361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:47.016309 13363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:47.017498 13355 server_base.cc:1034] running on GCE node
I20260806 04:45:47.018046 13355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:47.018843 13355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:47.020053 13355 hybrid_clock.cc:648] HybridClock initialized: now 1785991547020018 us; error 33 us; skew 500 ppm
I20260806 04:45:47.020364 13355 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:47 dist-test-slave-0b58 krb5kdc[13246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991547, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:47.023388 13355 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:45:47.024854 13355 webserver.cc:460] Webserver started at http://127.7.113.193:37857/ using document root <none> and password file <none>
I20260806 04:45:47.025499 13355 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:47.025631 13355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:47.025947 13355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:47.028908 13355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "7aef10adf9334eb98f6fa4d390f5cf81"
format_stamp: "Formatted at 2026-08-06 04:45:47 on dist-test-slave-0b58"
server_key: "fbe0eed81fd8b5ed7a34031a8984ef7a"
server_key_iv: "05ebc4d0a4ed3e944c4f5e67be6dfa1d"
server_key_version: "encryptionkey@0"
I20260806 04:45:47.029703 13355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "7aef10adf9334eb98f6fa4d390f5cf81"
format_stamp: "Formatted at 2026-08-06 04:45:47 on dist-test-slave-0b58"
server_key: "fbe0eed81fd8b5ed7a34031a8984ef7a"
server_key_iv: "05ebc4d0a4ed3e944c4f5e67be6dfa1d"
server_key_version: "encryptionkey@0"
I20260806 04:45:47.034632 13355 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260806 04:45:47.037940 13370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:47.039357 13355 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 04:45:47.039536 13355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "7aef10adf9334eb98f6fa4d390f5cf81"
format_stamp: "Formatted at 2026-08-06 04:45:47 on dist-test-slave-0b58"
server_key: "fbe0eed81fd8b5ed7a34031a8984ef7a"
server_key_iv: "05ebc4d0a4ed3e944c4f5e67be6dfa1d"
server_key_version: "encryptionkey@0"
I20260806 04:45:47.039736 13355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:47.053960 13355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:47.057636 13355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:47.057917 13355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:47.058811 13355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:47.060228 13355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:47.060389 13355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 04:45:47.060539 13355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:47.060612 13355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:47.093382 13355 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:34125
I20260806 04:45:47.093446 13484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:34125 every 8 connection(s)
I20260806 04:45:47.094621 13355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:45:47.100126 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 13355
I20260806 04:45:47.100422 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:45:47.101143 7623 external_mini_cluster.cc:1428] Setting key d1cac4f235f29fc7501e2930a3aec550
Aug 06 04:45:47 dist-test-slave-0b58 krb5kdc[13246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991547, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:47.118281 13488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:47.097040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:51273 (local address 127.7.113.254:41041)
0806 04:45:47.097438 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:47.097443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:47.098386 (+ 943us) server_negotiation.cc:407] Connection header received
0806 04:45:47.102552 (+ 4166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:47.102557 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:47.102644 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:47.102757 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:47.104888 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:47.105622 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:47.108060 (+ 2438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:47.108505 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:47.108599 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:47.112680 (+ 4081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:47.112685 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:47.112688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:47.112719 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:47.115268 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:47.115978 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:47.115988 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:47.115990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:47.116106 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:47.116588 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:47.116593 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:47.116602 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:47.116858 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:47.117021 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:47.117692 (+ 671us) server_negotiation.cc:299] Negotiation successful
0806 04:45:47.117923 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":194,"threads_started":1}
I20260806 04:45:47.119190 13489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:47.097559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41041 (local address 127.7.113.193:51273)
0806 04:45:47.098227 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:47.098268 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:47.102294 (+ 4026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:47.103158 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:47.103168 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:47.103881 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:47.104702 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:47.104728 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:47.105793 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:47.105801 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:47.107914 (+ 2113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:47.107931 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:47.108717 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:47.108726 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:47.109055 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:47.109782 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:47.109816 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:47.112463 (+ 2647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:47.115431 (+ 2968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:47.115439 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:47.115453 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:47.115848 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:47.116216 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:47.116221 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:47.116225 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:47.116466 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:47.116998 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:47.117005 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:47.117317 (+ 312us) client_negotiation.cc:769] Sending connection context
0806 04:45:47.117582 (+ 265us) client_negotiation.cc:240] Negotiation successful
0806 04:45:47.118078 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":274,"threads_started":1}
I20260806 04:45:47.120736 13485 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41041
I20260806 04:45:47.121042 13485 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:47.121774 13485 heartbeater.cc:511] Master 127.7.113.254:41041 requested a full tablet report, sending...
I20260806 04:45:47.124171 13291 ts_manager.cc:194] Registered new tserver with Master: 7aef10adf9334eb98f6fa4d390f5cf81 (127.7.113.193:34125)
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
I20260806 04:45:47.126286 13291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:51273
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:45:47.155678 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41041
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:39657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:47.473809 13492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:47.474053 13492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:47.474226 13492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:47.481452 13492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:47.481549 13492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:47.481779 13492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:45:47.491231 13492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:39657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:47.492565 13492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:47.493888 13492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:47.506738 13498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:47.506705 13500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:47.507504 13492 server_base.cc:1034] running on GCE node
W20260806 04:45:47.508754 13497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:47.509531 13492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:47.510537 13492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:47.511761 13492 hybrid_clock.cc:648] HybridClock initialized: now 1785991547511709 us; error 42 us; skew 500 ppm
I20260806 04:45:47.512107 13492 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:47 dist-test-slave-0b58 krb5kdc[13246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991547, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:47.515669 13492 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:45:47.517153 13492 webserver.cc:460] Webserver started at http://127.7.113.194:37821/ using document root <none> and password file <none>
I20260806 04:45:47.517805 13492 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:47.517949 13492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:47.518245 13492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:47.521168 13492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "41edee85de284d39b2a3b633da54ca90"
format_stamp: "Formatted at 2026-08-06 04:45:47 on dist-test-slave-0b58"
server_key: "214a9684e3430f5c629a9e61fd6bb244"
server_key_iv: "acbf252ec3b72838f48a36599c1d28ab"
server_key_version: "encryptionkey@0"
I20260806 04:45:47.521927 13492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "41edee85de284d39b2a3b633da54ca90"
format_stamp: "Formatted at 2026-08-06 04:45:47 on dist-test-slave-0b58"
server_key: "214a9684e3430f5c629a9e61fd6bb244"
server_key_iv: "acbf252ec3b72838f48a36599c1d28ab"
server_key_version: "encryptionkey@0"
I20260806 04:45:47.526903 13492 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 04:45:47.530229 13507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:47.531385 13492 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 04:45:47.531558 13492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "41edee85de284d39b2a3b633da54ca90"
format_stamp: "Formatted at 2026-08-06 04:45:47 on dist-test-slave-0b58"
server_key: "214a9684e3430f5c629a9e61fd6bb244"
server_key_iv: "acbf252ec3b72838f48a36599c1d28ab"
server_key_version: "encryptionkey@0"
I20260806 04:45:47.531749 13492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:47.545670 13492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:47.551460 13492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:47.551693 13492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:47.552645 13492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:47.553890 13492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:47.553961 13492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:47.554044 13492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:47.554090 13492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:47.585366 13492 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:33819
I20260806 04:45:47.585405 13621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:33819 every 8 connection(s)
I20260806 04:45:47.586723 13492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:45:47.596938 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 13492
I20260806 04:45:47.597158 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:45:47.597590 7623 external_mini_cluster.cc:1428] Setting key 0b60bcaec969257648b0b44bd741986e
Aug 06 04:45:47 dist-test-slave-0b58 krb5kdc[13246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991547, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:47.606540 13488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:47.589341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:47115 (local address 127.7.113.254:41041)
0806 04:45:47.589525 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:47.589529 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:47.590676 (+ 1147us) server_negotiation.cc:407] Connection header received
0806 04:45:47.592511 (+ 1835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:47.592517 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:47.592608 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:47.592714 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:47.594154 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:47.594866 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:47.596463 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:47.596876 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:47.597018 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:47.600869 (+ 3851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:47.600873 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:47.600877 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:47.600906 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:47.603460 (+ 2554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:47.604178 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:47.604187 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:47.604190 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:47.604373 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:47.604801 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:47.604806 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:47.604809 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:47.605095 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:47.605257 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:47.605933 (+ 676us) server_negotiation.cc:299] Negotiation successful
0806 04:45:47.606186 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 04:45:47.607460 13624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:47.589807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41041 (local address 127.7.113.194:47115)
0806 04:45:47.590518 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:47.590564 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:47.592187 (+ 1623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:47.592955 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:47.592963 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:47.593460 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:47.593990 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:47.594006 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:47.595014 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:47.595019 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:47.596249 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:47.596325 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:47.597106 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:47.597113 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:47.597393 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:47.598065 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:47.598110 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:47.600644 (+ 2534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:47.603612 (+ 2968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:47.603620 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:47.603635 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:47.604046 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:47.604485 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:47.604490 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:47.604493 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:47.604678 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:47.605228 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:47.605235 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:47.605570 (+ 335us) client_negotiation.cc:769] Sending connection context
0806 04:45:47.605837 (+ 267us) client_negotiation.cc:240] Negotiation successful
0806 04:45:47.606392 (+ 555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":286,"threads_started":1}
I20260806 04:45:47.608839 13622 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41041
I20260806 04:45:47.609184 13622 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:47.610041 13622 heartbeater.cc:511] Master 127.7.113.254:41041 requested a full tablet report, sending...
I20260806 04:45:47.611518 13291 ts_manager.cc:194] Registered new tserver with Master: 41edee85de284d39b2a3b633da54ca90 (127.7.113.194:33819)
I20260806 04:45:47.612872 13291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:47115
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:45:47.663103 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41041
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:39657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:47.989065 13627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:47.989347 13627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:47.989444 13627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:47.996485 13627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:47.996591 13627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:47.996704 13627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:45:48.006389 13627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:39657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:48.007611 13627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:48.008939 13627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:48.021951 13632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:48.021915 13635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:48.022012 13633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:48.023380 13627 server_base.cc:1034] running on GCE node
I20260806 04:45:48.023989 13627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:48.025018 13627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:48.026302 13627 hybrid_clock.cc:648] HybridClock initialized: now 1785991548026239 us; error 52 us; skew 500 ppm
I20260806 04:45:48.026603 13627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991548, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:48.029735 13627 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:45:48.031131 13627 webserver.cc:460] Webserver started at http://127.7.113.195:45361/ using document root <none> and password file <none>
I20260806 04:45:48.031786 13627 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:48.031919 13627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:48.032222 13627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:48.035188 13627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "f63a1c79c5b74003a12bc9ba5306fca9"
format_stamp: "Formatted at 2026-08-06 04:45:48 on dist-test-slave-0b58"
server_key: "baff19c5736a4948a37b9e020a134e37"
server_key_iv: "9594876c91e2da2038d3eab06d0364ce"
server_key_version: "encryptionkey@0"
I20260806 04:45:48.035961 13627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "f63a1c79c5b74003a12bc9ba5306fca9"
format_stamp: "Formatted at 2026-08-06 04:45:48 on dist-test-slave-0b58"
server_key: "baff19c5736a4948a37b9e020a134e37"
server_key_iv: "9594876c91e2da2038d3eab06d0364ce"
server_key_version: "encryptionkey@0"
I20260806 04:45:48.040894 13627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260806 04:45:48.044435 13642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:48.045825 13627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 04:45:48.045950 13627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "f63a1c79c5b74003a12bc9ba5306fca9"
format_stamp: "Formatted at 2026-08-06 04:45:48 on dist-test-slave-0b58"
server_key: "baff19c5736a4948a37b9e020a134e37"
server_key_iv: "9594876c91e2da2038d3eab06d0364ce"
server_key_version: "encryptionkey@0"
I20260806 04:45:48.046105 13627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:48.062264 13627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:48.065892 13627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:48.066112 13627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:48.066991 13627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:48.068187 13627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:48.068305 13627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:48.068466 13627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:48.068517 13627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:48.102222 13627 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:36961
I20260806 04:45:48.102260 13755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:36961 every 8 connection(s)
I20260806 04:45:48.103410 13627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:45:48.106453 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 13627
I20260806 04:45:48.106675 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:45:48.107259 7623 external_mini_cluster.cc:1428] Setting key 90d533ef594063628951b4282039641d
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991548, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:45:48.124547 13488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:48.105787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:60729 (local address 127.7.113.254:41041)
0806 04:45:48.105988 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:48.105994 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:48.107348 (+ 1354us) server_negotiation.cc:407] Connection header received
0806 04:45:48.109889 (+ 2541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:48.109895 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:48.109984 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:48.110100 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:48.111730 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.112570 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.114031 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.114435 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.114529 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:48.117844 (+ 3315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:48.117849 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:48.117852 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:48.117883 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:48.120663 (+ 2780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:48.121480 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:48.121484 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:48.121486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:48.121713 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:48.122191 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:48.122198 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:48.122201 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:48.122530 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:48.123947 (+ 1417us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:48.124063 (+ 116us) server_negotiation.cc:299] Negotiation successful
0806 04:45:48.124215 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 04:45:48.125028 13758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:48.106280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41041 (local address 127.7.113.195:60729)
0806 04:45:48.107139 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:48.107192 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:48.109636 (+ 2444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:48.110431 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:48.110439 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:48.111039 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:48.111573 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:48.111590 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.112708 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.112711 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:48.113893 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:48.113905 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.114622 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.114626 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:48.114818 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:48.115456 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:48.115477 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:48.117606 (+ 2129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:48.120793 (+ 3187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:48.120802 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:48.120816 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:48.121380 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:48.121831 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:48.121834 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:48.121837 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:48.122083 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:48.122683 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:48.122690 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:48.123108 (+ 418us) client_negotiation.cc:769] Sending connection context
0806 04:45:48.123390 (+ 282us) client_negotiation.cc:240] Negotiation successful
0806 04:45:48.123887 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":375,"threads_started":1}
I20260806 04:45:48.126288 13756 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41041
I20260806 04:45:48.126587 13756 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:48.127290 13756 heartbeater.cc:511] Master 127.7.113.254:41041 requested a full tablet report, sending...
I20260806 04:45:48.128748 13291 ts_manager.cc:194] Registered new tserver with Master: f63a1c79c5b74003a12bc9ba5306fca9 (127.7.113.195:36961)
I20260806 04:45:48.129390 13485 heartbeater.cc:503] Master 127.7.113.254:41041 was elected leader, sending a full tablet report...
I20260806 04:45:48.129629 13291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:60729
I20260806 04:45:48.134799 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/test-admin.keytab.
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:48.166522 7623 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260806 04:45:48.171708 13763 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:45:48.169070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43954 (local address 127.7.113.193:34125)
0806 04:45:48.169738 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:48.169747 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:48.169780 (+ 33us) server_negotiation.cc:407] Connection header received
0806 04:45:48.169912 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:48.169919 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:48.170129 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:48.170303 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:48.171208 (+ 905us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43954: BlockingRecv error: recv got EOF from 127.0.0.1:43954 (error 108)
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":307,"threads_started":1}
W20260806 04:45:48.171759 7623 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/krb5cc' of type FILE
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:48.173532 7623 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:48.174957 7623 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:45:48.189419 13763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:48.176662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43958 (local address 127.7.113.193:34125)
0806 04:45:48.176860 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:48.176864 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:48.176959 (+ 95us) server_negotiation.cc:407] Connection header received
0806 04:45:48.177070 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:48.177073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:48.177129 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:48.177206 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:48.178177 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.179118 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.180402 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.180960 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.181057 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:48.184335 (+ 3278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:48.184346 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:48.184359 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:48.184395 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:48.186893 (+ 2498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:48.187464 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:48.187471 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:48.187473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:48.187602 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:48.187918 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:48.187921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:48.187923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:48.188242 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:48.188585 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:48.188912 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 04:45:48.189168 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260806 04:45:48.194893 13763 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:45:48.193194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43970 (local address 127.7.113.193:34125)
0806 04:45:48.193394 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:48.193399 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:48.193579 (+ 180us) server_negotiation.cc:407] Connection header received
0806 04:45:48.193751 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:48.193755 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:48.193834 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:48.193930 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:48.194679 (+ 749us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43970: BlockingRecv error: recv got EOF from 127.0.0.1:43970 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260806 04:45:48.195078 7623 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/krb5cc' of type FILE
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:48.196548 7623 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:48.197873 7623 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:45:48.211158 13763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:48.199238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43982 (local address 127.7.113.193:34125)
0806 04:45:48.199417 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:48.199422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:48.199612 (+ 190us) server_negotiation.cc:407] Connection header received
0806 04:45:48.199737 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:48.199740 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:48.199790 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:48.199861 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:48.200839 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.201505 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.202655 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.203073 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.203159 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:48.206857 (+ 3698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:48.206861 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:48.206865 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:48.206891 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:48.209132 (+ 2241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:48.209670 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:48.209673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:48.209675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:48.209777 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:48.210110 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:48.210113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:48.210115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:48.210345 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:48.210516 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:48.210735 (+ 219us) server_negotiation.cc:299] Negotiation successful
0806 04:45:48.210908 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260806 04:45:48.215066 13763 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:45:48.213551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43986 (local address 127.7.113.193:34125)
0806 04:45:48.213674 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:48.213678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:48.214006 (+ 328us) server_negotiation.cc:407] Connection header received
0806 04:45:48.214098 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:48.214101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:48.214158 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:48.214228 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:48.214851 (+ 623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43986: BlockingRecv error: recv got EOF from 127.0.0.1:43986 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260806 04:45:48.215219 7623 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785991498713577-7623-0/krb5kdc/krb5cc' of type FILE
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:48.216742 7623 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:48.217983 7623 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:45:48.233858 13763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:48.219182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44000 (local address 127.7.113.193:34125)
0806 04:45:48.219372 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:48.219378 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:48.219584 (+ 206us) server_negotiation.cc:407] Connection header received
0806 04:45:48.219739 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:48.219744 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:48.219805 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:48.219896 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:48.220908 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.221632 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.222856 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.223247 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.223373 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:48.227597 (+ 4224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:48.227603 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:48.227607 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:48.227646 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:48.230999 (+ 3353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:48.231916 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:48.231923 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:48.231926 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:48.232086 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:48.232515 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:48.232520 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:48.232524 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:48.232856 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:48.233175 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:48.233386 (+ 211us) server_negotiation.cc:299] Negotiation successful
0806 04:45:48.233577 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 04:45:48.235419 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 13355
I20260806 04:45:48.247515 13763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:48.236099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44008 (local address 127.7.113.193:34125)
0806 04:45:48.236246 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:48.236249 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:48.236663 (+ 414us) server_negotiation.cc:407] Connection header received
0806 04:45:48.236847 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:48.236853 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:48.237008 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:48.237137 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:48.238058 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.238752 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.239994 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.240529 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.240657 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:48.242566 (+ 1909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:48.242571 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:48.242574 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:48.242601 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:48.245054 (+ 2453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:48.245669 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:48.245675 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:48.245678 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:48.245811 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:48.246190 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:48.246196 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:48.246199 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:48.246453 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:48.246726 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:48.247036 (+ 310us) server_negotiation.cc:299] Negotiation successful
0806 04:45:48.247229 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 04:45:48.248087 13480 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:48.350334 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 13355
I20260806 04:45:48.374431 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 13492
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:45:48.389793 13776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:48.375484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52548 (local address 127.7.113.194:33819)
0806 04:45:48.376444 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:48.376452 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:48.376477 (+ 25us) server_negotiation.cc:407] Connection header received
0806 04:45:48.376538 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:48.376545 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:48.376747 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:48.376876 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:48.377798 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.378799 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.379933 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.380561 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.380631 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:48.384409 (+ 3778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:48.384422 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:48.384438 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:48.384478 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:48.387295 (+ 2817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:48.387885 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:48.387891 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:48.387894 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:48.388022 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:48.388436 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:48.388439 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:48.388441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:48.388756 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:48.388961 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:48.389235 (+ 274us) server_negotiation.cc:299] Negotiation successful
0806 04:45:48.389505 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":810,"thread_start_us":638,"threads_started":1}
I20260806 04:45:48.391003 13617 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:48.473069 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 13492
I20260806 04:45:48.490587 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 13627
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:45:48.506261 13778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:48.491585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60424 (local address 127.7.113.195:36961)
0806 04:45:48.492178 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:48.492184 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:48.492212 (+ 28us) server_negotiation.cc:407] Connection header received
0806 04:45:48.492343 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:48.492357 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:48.492560 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:48.492739 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:48.493857 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.494902 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.496161 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:48.496805 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:48.496940 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:48.500873 (+ 3933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:48.500884 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:48.500897 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:48.500928 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:48.503827 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:48.504458 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:48.504465 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:48.504467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:48.504586 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:48.504887 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:48.504890 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:48.504892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:48.505243 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:48.505477 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:48.505664 (+ 187us) server_negotiation.cc:299] Negotiation successful
0806 04:45:48.505920 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":296,"threads_started":1}
I20260806 04:45:48.507566 13751 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:48.590106 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 13627
I20260806 04:45:48.607537 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 13259
I20260806 04:45:48.608762 13323 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:48.710208 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 13259
2026-08-06T04:45:48Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3954 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13783](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13783](info): set up 2 sockets
Aug 06 04:45:48 dist-test-slave-0b58 krb5kdc[13783](info): commencing operation
krb5kdc: starting...
W20260806 04:45:49.795104 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:45:49 dist-test-slave-0b58 krb5kdc[13783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:45:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:45:49Z Disabled control of system clock
WARNING: no policy specified for oryx/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.254.keytab.
Entry for principal oryx/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.254.keytab.
I20260806 04:45:50.027916 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:41047
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.254.keytab
--principal=oryx/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:42843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:41047
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:50.348417 13796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:50.348682 13796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:50.348845 13796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:50.355949 13796 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:50.356063 13796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:50.356122 13796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:50.356204 13796 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:50.356351 13796 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:45:50.365504 13796 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:42843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:41047
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.254.keytab
--principal=oryx/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:41047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:50.366768 13796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:50.368009 13796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:50.379590 13802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:50.379671 13801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:50.379647 13804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:50.380918 13796 server_base.cc:1034] running on GCE node
I20260806 04:45:50.381598 13796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:50.382838 13796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:50.384054 13796 hybrid_clock.cc:648] HybridClock initialized: now 1785991550384005 us; error 46 us; skew 500 ppm
I20260806 04:45:50.384421 13796 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:50 dist-test-slave-0b58 krb5kdc[13783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991550, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:50.390594 13796 init.cc:377] Logged in from keytab as oryx/127.7.113.254@KRBTEST.COM (short username oryx)
I20260806 04:45:50.391913 13796 webserver.cc:460] Webserver started at http://127.7.113.254:33245/ using document root <none> and password file <none>
I20260806 04:45:50.392678 13796 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:50.392813 13796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:50.393118 13796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:50.395915 13796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "2abfd07f6b904abe93be3f40932d6c70"
format_stamp: "Formatted at 2026-08-06 04:45:50 on dist-test-slave-0b58"
server_key: "6f53dcfc54aba7fb60c0200a347938ee"
server_key_iv: "5c7f019da81a0b46b968a0b6d926e108"
server_key_version: "encryptionkey@0"
I20260806 04:45:50.396709 13796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "2abfd07f6b904abe93be3f40932d6c70"
format_stamp: "Formatted at 2026-08-06 04:45:50 on dist-test-slave-0b58"
server_key: "6f53dcfc54aba7fb60c0200a347938ee"
server_key_iv: "5c7f019da81a0b46b968a0b6d926e108"
server_key_version: "encryptionkey@0"
I20260806 04:45:50.401618 13796 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260806 04:45:50.404853 13811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:50.406064 13796 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 04:45:50.406271 13796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "2abfd07f6b904abe93be3f40932d6c70"
format_stamp: "Formatted at 2026-08-06 04:45:50 on dist-test-slave-0b58"
server_key: "6f53dcfc54aba7fb60c0200a347938ee"
server_key_iv: "5c7f019da81a0b46b968a0b6d926e108"
server_key_version: "encryptionkey@0"
I20260806 04:45:50.406445 13796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:50.427855 13796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:50.431900 13796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:50.432127 13796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:50.450213 13796 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:41047
I20260806 04:45:50.450246 13863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:41047 every 8 connection(s)
I20260806 04:45:50.451532 13796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:45:50.455209 13864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:50.457480 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 13796
I20260806 04:45:50.457720 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:45:50.458508 7623 external_mini_cluster.cc:1428] Setting key 4579f6d67e818dd14aea0a201e5312c4
I20260806 04:45:50.467437 13864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70: Bootstrap starting.
I20260806 04:45:50.471158 13864 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:50.472438 13864 log.cc:824] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70: Log is configured to *not* fsync() on all Append() calls
Aug 06 04:45:50 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
I20260806 04:45:50.475262 13864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70: No bootstrap required, opened a new log
I20260806 04:45:50.481387 13867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:50.460621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43108 (local address 127.7.113.254:41047)
0806 04:45:50.461390 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:50.461400 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:50.461439 (+ 39us) server_negotiation.cc:407] Connection header received
0806 04:45:50.463049 (+ 1610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:50.463070 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:50.463435 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:50.463732 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:50.465556 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:50.466817 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:50.468575 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:50.469213 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:50.469353 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:50.474142 (+ 4789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:50.474161 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:50.474174 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:50.474211 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:50.477333 (+ 3122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:50.478015 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:50.478021 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:50.478027 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:50.478181 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:50.478578 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:50.478585 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:50.478587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:50.479076 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:50.479459 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:50.479912 (+ 453us) server_negotiation.cc:299] Negotiation successful
0806 04:45:50.480394 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":352,"threads_started":1}
I20260806 04:45:50.483094 13864 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } }
I20260806 04:45:50.483469 13864 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:50.483595 13864 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2abfd07f6b904abe93be3f40932d6c70, State: Initialized, Role: FOLLOWER
I20260806 04:45:50.484221 13864 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } }
I20260806 04:45:50.484509 13864 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:45:50.484651 13864 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:45:50.484846 13864 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:50.486887 13864 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } }
I20260806 04:45:50.487346 13864 leader_election.cc:302] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2abfd07f6b904abe93be3f40932d6c70; no voters:
I20260806 04:45:50.488023 13864 leader_election.cc:288] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:45:50.488158 13869 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:50.488897 13869 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [term 1 LEADER]: Becoming Leader. State: Replica: 2abfd07f6b904abe93be3f40932d6c70, State: Running, Role: LEADER
I20260806 04:45:50.489507 13869 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } }
I20260806 04:45:50.490229 13864 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:50.492491 13870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } }
I20260806 04:45:50.492517 13871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2abfd07f6b904abe93be3f40932d6c70. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } }
I20260806 04:45:50.492835 13870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:50.492866 13871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:50.497611 13876 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:50.503139 13876 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:50.511312 13876 catalog_manager.cc:1347] Generated new cluster ID: 888aec365cc44d21aeeb9bcb509691e9
I20260806 04:45:50.511425 13876 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:50.532806 13876 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:45:50.534003 13876 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:50.543931 13876 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70: Generated new TSK 0
I20260806 04:45:50.544898 13876 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.193.keytab.
Entry for principal oryx/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.193.keytab.
I20260806 04:45:50.616082 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41047
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.193.keytab
--principal=oryx/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:42843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:50.946664 13890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:50.946944 13890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:50.947041 13890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:50.954348 13890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:50.954450 13890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:50.954559 13890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:45:50.963945 13890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:42843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.193.keytab
--principal=oryx/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41047
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:50.965222 13890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:50.966454 13890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:50.979352 13895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:50.979324 13896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:50.979568 13898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:50.980465 13890 server_base.cc:1034] running on GCE node
I20260806 04:45:50.981117 13890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:50.981951 13890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:50.983145 13890 hybrid_clock.cc:648] HybridClock initialized: now 1785991550983086 us; error 50 us; skew 500 ppm
I20260806 04:45:50.983407 13890 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:50 dist-test-slave-0b58 krb5kdc[13783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991550, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:50.986528 13890 init.cc:377] Logged in from keytab as oryx/127.7.113.193@KRBTEST.COM (short username oryx)
I20260806 04:45:50.987823 13890 webserver.cc:460] Webserver started at http://127.7.113.193:42805/ using document root <none> and password file <none>
I20260806 04:45:50.988545 13890 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:50.988646 13890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:50.988898 13890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:50.992002 13890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "bdbca05291a74430a535417c808f5b56"
format_stamp: "Formatted at 2026-08-06 04:45:50 on dist-test-slave-0b58"
server_key: "807691bf77e180aada18786d1f0286eb"
server_key_iv: "f7de271f4c3d94e0b5f639f00a7d34af"
server_key_version: "encryptionkey@0"
I20260806 04:45:50.992799 13890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "bdbca05291a74430a535417c808f5b56"
format_stamp: "Formatted at 2026-08-06 04:45:50 on dist-test-slave-0b58"
server_key: "807691bf77e180aada18786d1f0286eb"
server_key_iv: "f7de271f4c3d94e0b5f639f00a7d34af"
server_key_version: "encryptionkey@0"
I20260806 04:45:50.997896 13890 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:45:51.001364 13905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:51.002653 13890 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:45:51.002794 13890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "bdbca05291a74430a535417c808f5b56"
format_stamp: "Formatted at 2026-08-06 04:45:50 on dist-test-slave-0b58"
server_key: "807691bf77e180aada18786d1f0286eb"
server_key_iv: "f7de271f4c3d94e0b5f639f00a7d34af"
server_key_version: "encryptionkey@0"
I20260806 04:45:51.002954 13890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:51.017131 13890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:51.021299 13890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:51.021533 13890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:51.022392 13890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:51.023628 13890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:51.023701 13890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:51.023793 13890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:51.023838 13890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:51.057401 13890 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:35253
I20260806 04:45:51.057451 14019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:35253 every 8 connection(s)
I20260806 04:45:51.058703 13890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:45:51.061734 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 13890
I20260806 04:45:51.061960 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:45:51.062911 7623 external_mini_cluster.cc:1428] Setting key aa5cbb955dcbaa80f03252473528acc1
Aug 06 04:45:51 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991550, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
I20260806 04:45:51.082705 14022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:51.061197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:55919 (local address 127.7.113.254:41047)
0806 04:45:51.061734 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:51.061740 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:51.062931 (+ 1191us) server_negotiation.cc:407] Connection header received
0806 04:45:51.065202 (+ 2271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:51.065206 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:51.065274 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:51.065368 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:51.067505 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:51.068189 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:51.070779 (+ 2590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:51.071181 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:51.071313 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:51.075758 (+ 4445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:51.075765 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:51.075768 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:51.075806 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:51.079406 (+ 3600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:51.080103 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:51.080111 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:51.080117 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:51.080295 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:51.080703 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:51.080710 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:51.080716 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:51.081121 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:51.081272 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:51.081945 (+ 673us) server_negotiation.cc:299] Negotiation successful
0806 04:45:51.082197 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":249,"threads_started":1}
I20260806 04:45:51.083340 14023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:51.061752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.193:55919)
0806 04:45:51.062730 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:51.062790 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:51.064897 (+ 2107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:51.065646 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:51.065658 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:51.066466 (+ 808us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:51.067311 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:51.067353 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:51.068395 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:51.068403 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:51.070530 (+ 2127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:51.070548 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:51.071453 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:51.071462 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:51.071808 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:51.072585 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:51.072618 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:51.075482 (+ 2864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:51.079548 (+ 4066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:51.079555 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:51.079568 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:51.079982 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:51.080408 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:51.080411 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:51.080413 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:51.080589 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:51.081251 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:51.081257 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:51.081584 (+ 327us) client_negotiation.cc:769] Sending connection context
0806 04:45:51.081814 (+ 230us) client_negotiation.cc:240] Negotiation successful
0806 04:45:51.082186 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":342,"threads_started":1}
I20260806 04:45:51.085039 14020 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41047
I20260806 04:45:51.085404 14020 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:51.086324 14020 heartbeater.cc:511] Master 127.7.113.254:41047 requested a full tablet report, sending...
I20260806 04:45:51.088685 13828 ts_manager.cc:194] Registered new tserver with Master: bdbca05291a74430a535417c808f5b56 (127.7.113.193:35253)
I20260806 04:45:51.090102 13828 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:55919
WARNING: no policy specified for oryx/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.194.keytab.
Entry for principal oryx/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.194.keytab.
I20260806 04:45:51.123601 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41047
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.194.keytab
--principal=oryx/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:42843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:51.447965 14026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:51.448233 14026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:51.448467 14026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:51.455659 14026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:51.455760 14026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:51.455936 14026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:45:51.465523 14026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:42843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.194.keytab
--principal=oryx/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41047
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:51.466797 14026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:51.468051 14026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:51.481581 14034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:51.481633 14031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:51.481667 14032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:51.482512 14026 server_base.cc:1034] running on GCE node
I20260806 04:45:51.483115 14026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:51.484089 14026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:51.485311 14026 hybrid_clock.cc:648] HybridClock initialized: now 1785991551485278 us; error 44 us; skew 500 ppm
I20260806 04:45:51.485628 14026 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:51 dist-test-slave-0b58 krb5kdc[13783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991551, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:51.488862 14026 init.cc:377] Logged in from keytab as oryx/127.7.113.194@KRBTEST.COM (short username oryx)
I20260806 04:45:51.490304 14026 webserver.cc:460] Webserver started at http://127.7.113.194:40167/ using document root <none> and password file <none>
I20260806 04:45:51.491118 14026 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:51.491266 14026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:51.491581 14026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:51.494506 14026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "d549e48698944b0783d02570ba6e1e86"
format_stamp: "Formatted at 2026-08-06 04:45:51 on dist-test-slave-0b58"
server_key: "8cdc402572a3eb7a37912cedd052ef1f"
server_key_iv: "87d4cb9a0ffaf1dace7fce65e8a2e23f"
server_key_version: "encryptionkey@0"
I20260806 04:45:51.495267 14026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "d549e48698944b0783d02570ba6e1e86"
format_stamp: "Formatted at 2026-08-06 04:45:51 on dist-test-slave-0b58"
server_key: "8cdc402572a3eb7a37912cedd052ef1f"
server_key_iv: "87d4cb9a0ffaf1dace7fce65e8a2e23f"
server_key_version: "encryptionkey@0"
I20260806 04:45:51.500742 14026 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260806 04:45:51.503925 14041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:51.505237 14026 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:45:51.505376 14026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "d549e48698944b0783d02570ba6e1e86"
format_stamp: "Formatted at 2026-08-06 04:45:51 on dist-test-slave-0b58"
server_key: "8cdc402572a3eb7a37912cedd052ef1f"
server_key_iv: "87d4cb9a0ffaf1dace7fce65e8a2e23f"
server_key_version: "encryptionkey@0"
I20260806 04:45:51.505548 14026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:51.522030 14026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:51.526242 14026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:51.526481 14026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:51.527354 14026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:51.528699 14026 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:51.528800 14026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:51.528957 14026 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:51.529021 14026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:51.562963 14026 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:43141
I20260806 04:45:51.563009 14156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:43141 every 8 connection(s)
I20260806 04:45:51.564613 14026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:45:51.568122 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 14026
I20260806 04:45:51.568337 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:45:51.568872 7623 external_mini_cluster.cc:1428] Setting key a6f66a0f5889c1501dbb06c7fa78c535
Aug 06 04:45:51 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991551, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
I20260806 04:45:51.585834 14022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:51.567185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:44247 (local address 127.7.113.254:41047)
0806 04:45:51.567369 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:51.567373 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:51.568688 (+ 1315us) server_negotiation.cc:407] Connection header received
0806 04:45:51.570744 (+ 2056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:51.570749 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:51.570844 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:51.570949 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:51.572470 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:51.573168 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:51.574755 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:51.575195 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:51.575338 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:51.578979 (+ 3641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:51.578984 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:51.578988 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:51.579019 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:51.582536 (+ 3517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:51.583249 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:51.583258 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:51.583264 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:51.583444 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:51.583850 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:51.583858 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:51.583864 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:51.584241 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:51.584430 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:51.585101 (+ 671us) server_negotiation.cc:299] Negotiation successful
0806 04:45:51.585370 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 04:45:51.586412 14159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:51.567663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.194:44247)
0806 04:45:51.568530 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:51.568572 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:51.570427 (+ 1855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:51.571187 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:51.571195 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:51.571689 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:51.572244 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:51.572326 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:51.573363 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:51.573367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:51.574601 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:51.574613 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:51.575449 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:51.575457 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:51.575679 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:51.576406 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:51.576432 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:51.578745 (+ 2313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:51.582676 (+ 3931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:51.582683 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:51.582695 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:51.583106 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:51.583557 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:51.583560 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:51.583562 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:51.583724 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:51.584401 (+ 677us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:51.584407 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:51.584708 (+ 301us) client_negotiation.cc:769] Sending connection context
0806 04:45:51.584933 (+ 225us) client_negotiation.cc:240] Negotiation successful
0806 04:45:51.585298 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":338,"threads_started":1}
I20260806 04:45:51.587836 14157 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41047
I20260806 04:45:51.588132 14157 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:51.588847 14157 heartbeater.cc:511] Master 127.7.113.254:41047 requested a full tablet report, sending...
I20260806 04:45:51.590291 13828 ts_manager.cc:194] Registered new tserver with Master: d549e48698944b0783d02570ba6e1e86 (127.7.113.194:43141)
I20260806 04:45:51.591321 13828 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:44247
WARNING: no policy specified for oryx/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.195.keytab.
Entry for principal oryx/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.195.keytab.
I20260806 04:45:51.623296 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41047
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.195.keytab
--principal=oryx/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:42843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:51.949503 14162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:51.949863 14162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:51.950042 14162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:51.957401 14162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:51.957542 14162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:51.957719 14162 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:45:51.967195 14162 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:42843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.195.keytab
--principal=oryx/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41047
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:51.968485 14162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:51.969763 14162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:51.982839 14170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:51.982892 14167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:51.982877 14168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:51.983713 14162 server_base.cc:1034] running on GCE node
I20260806 04:45:51.984300 14162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:51.985337 14162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:51.986523 14162 hybrid_clock.cc:648] HybridClock initialized: now 1785991551986473 us; error 46 us; skew 500 ppm
I20260806 04:45:51.986820 14162 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:51 dist-test-slave-0b58 krb5kdc[13783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991551, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:51.990001 14162 init.cc:377] Logged in from keytab as oryx/127.7.113.195@KRBTEST.COM (short username oryx)
I20260806 04:45:51.991490 14162 webserver.cc:460] Webserver started at http://127.7.113.195:34801/ using document root <none> and password file <none>
I20260806 04:45:51.992130 14162 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:51.992261 14162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:51.992592 14162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:51.995368 14162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "46c62df0e34242ef92aa687777c61cec"
format_stamp: "Formatted at 2026-08-06 04:45:51 on dist-test-slave-0b58"
server_key: "2dacb6d4b4f0f4ac3645647f89d1d9b2"
server_key_iv: "6c28f7aedc81c34b03cf412995dcdcf6"
server_key_version: "encryptionkey@0"
I20260806 04:45:51.996105 14162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "46c62df0e34242ef92aa687777c61cec"
format_stamp: "Formatted at 2026-08-06 04:45:51 on dist-test-slave-0b58"
server_key: "2dacb6d4b4f0f4ac3645647f89d1d9b2"
server_key_iv: "6c28f7aedc81c34b03cf412995dcdcf6"
server_key_version: "encryptionkey@0"
I20260806 04:45:52.001066 14162 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260806 04:45:52.004391 14177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:52.005705 14162 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:45:52.005980 14162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "46c62df0e34242ef92aa687777c61cec"
format_stamp: "Formatted at 2026-08-06 04:45:51 on dist-test-slave-0b58"
server_key: "2dacb6d4b4f0f4ac3645647f89d1d9b2"
server_key_iv: "6c28f7aedc81c34b03cf412995dcdcf6"
server_key_version: "encryptionkey@0"
I20260806 04:45:52.006199 14162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:52.025493 14162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:52.029942 14162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:52.030256 14162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:52.031208 14162 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:52.032590 14162 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:52.032691 14162 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:52.032840 14162 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:52.032912 14162 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:52.066015 14162 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:33369
I20260806 04:45:52.066095 14290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:33369 every 8 connection(s)
I20260806 04:45:52.067232 14162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:45:52.075310 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 14162
I20260806 04:45:52.075516 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:45:52.075954 7623 external_mini_cluster.cc:1428] Setting key 07869cfe9edade861c6f4e55a3fbf398
Aug 06 04:45:52 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991551, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
I20260806 04:45:52.087469 14022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.069707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:54399 (local address 127.7.113.254:41047)
0806 04:45:52.069915 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:52.069921 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:52.071007 (+ 1086us) server_negotiation.cc:407] Connection header received
0806 04:45:52.072770 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:52.072775 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:52.072853 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:52.072940 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:52.074259 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.075134 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.077153 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.077738 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.077893 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.081897 (+ 4004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:52.081902 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:52.081906 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:52.081938 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:52.084609 (+ 2671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.085413 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.085417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.085420 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.085550 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.085973 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.085976 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.085978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.086260 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:52.086383 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:52.087050 (+ 667us) server_negotiation.cc:299] Negotiation successful
0806 04:45:52.087214 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 04:45:52.088815 14293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.070177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.195:54399)
0806 04:45:52.070855 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:52.070891 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:52.072537 (+ 1646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:52.073133 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:52.073140 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:52.073599 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:52.074126 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:52.074141 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.075286 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.075290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:52.076971 (+ 1681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:52.076983 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.077998 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.078010 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:52.078251 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.078953 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:52.078989 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:52.081675 (+ 2686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:52.084750 (+ 3075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:52.084757 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:52.084770 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:52.085275 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:52.085658 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:52.085662 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:52.085664 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:52.085867 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:52.086373 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:52.086379 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:52.086722 (+ 343us) client_negotiation.cc:769] Sending connection context
0806 04:45:52.086971 (+ 249us) client_negotiation.cc:240] Negotiation successful
0806 04:45:52.087605 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":260,"threads_started":1}
I20260806 04:45:52.090615 14291 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41047
I20260806 04:45:52.091012 14291 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:52.092044 14291 heartbeater.cc:511] Master 127.7.113.254:41047 requested a full tablet report, sending...
I20260806 04:45:52.093171 14020 heartbeater.cc:503] Master 127.7.113.254:41047 was elected leader, sending a full tablet report...
I20260806 04:45:52.093633 13828 ts_manager.cc:194] Registered new tserver with Master: 46c62df0e34242ef92aa687777c61cec (127.7.113.195:33369)
I20260806 04:45:52.094501 13828 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:54399
I20260806 04:45:52.104384 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.7.113.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.113.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.113.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.253.keytab.
Entry for principal oryx/127.7.113.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.253.keytab.
I20260806 04:45:52.163900 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.253:40771
--webserver_interface=127.7.113.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.253.keytab
--principal=oryx/127.7.113.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:42843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:41047,127.7.113.253:40771
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:52.496719 14296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:52.497078 14296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:52.497249 14296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:52.504381 14296 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:52.504511 14296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:52.504618 14296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:52.504736 14296 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:52.504825 14296 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:45:52.515280 14296 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:42843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:41047,127.7.113.253:40771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.253.keytab
--principal=oryx/127.7.113.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.253:40771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.113.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
W20260806 04:45:52.515679 14296 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.7.113.254:41047,127.7.113.253:40771'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260806 04:45:52.516882 14296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:52.518224 14296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:52.530146 14301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:52.530104 14304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:52.530061 14302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:52.530932 14296 server_base.cc:1034] running on GCE node
I20260806 04:45:52.531737 14296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:52.533209 14296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:52.534431 14296 hybrid_clock.cc:648] HybridClock initialized: now 1785991552534372 us; error 29 us; skew 500 ppm
I20260806 04:45:52.534760 14296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:52 dist-test-slave-0b58 krb5kdc[13783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991552, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:52.537953 14296 init.cc:377] Logged in from keytab as oryx/127.7.113.253@KRBTEST.COM (short username oryx)
I20260806 04:45:52.539335 14296 webserver.cc:460] Webserver started at http://127.7.113.253:46401/ using document root <none> and password file <none>
I20260806 04:45:52.540055 14296 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:52.540190 14296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:52.540565 14296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:52.543514 14296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/data/instance:
uuid: "ae6926d5ce374b189a76c42492abe2f7"
format_stamp: "Formatted at 2026-08-06 04:45:52 on dist-test-slave-0b58"
server_key: "7d19616f3699379f536e7ae61b574871"
server_key_iv: "fb814e26d8ba27a91755c281bc372143"
server_key_version: "encryptionkey@0"
I20260806 04:45:52.544312 14296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/wal/instance:
uuid: "ae6926d5ce374b189a76c42492abe2f7"
format_stamp: "Formatted at 2026-08-06 04:45:52 on dist-test-slave-0b58"
server_key: "7d19616f3699379f536e7ae61b574871"
server_key_iv: "fb814e26d8ba27a91755c281bc372143"
server_key_version: "encryptionkey@0"
I20260806 04:45:52.549260 14296 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260806 04:45:52.552512 14311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:52.553731 14296 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:45:52.553918 14296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/wal
uuid: "ae6926d5ce374b189a76c42492abe2f7"
format_stamp: "Formatted at 2026-08-06 04:45:52 on dist-test-slave-0b58"
server_key: "7d19616f3699379f536e7ae61b574871"
server_key_iv: "fb814e26d8ba27a91755c281bc372143"
server_key_version: "encryptionkey@0"
I20260806 04:45:52.554140 14296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:52.593801 14157 heartbeater.cc:503] Master 127.7.113.254:41047 was elected leader, sending a full tablet report...
I20260806 04:45:52.597366 14296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:52.602125 14296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:52.602425 14296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:52.622112 14296 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.253:40771
I20260806 04:45:52.622124 14362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.253:40771 every 8 connection(s)
I20260806 04:45:52.623533 14296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/data/info.pb
I20260806 04:45:52.627247 14363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:52.628460 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 14296
I20260806 04:45:52.636472 14363 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:45:52 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.113.253@KRBTEST.COM
Aug 06 04:45:52 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991552, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.253@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
I20260806 04:45:52.652340 14366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.630775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59906 (local address 127.7.113.253:40771)
0806 04:45:52.631612 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:52.631622 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:52.631664 (+ 42us) server_negotiation.cc:407] Connection header received
0806 04:45:52.633700 (+ 2036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:52.633723 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:52.634129 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:52.634529 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:52.636097 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.637573 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.638912 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.639899 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.640100 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.644511 (+ 4411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:52.644521 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:52.644536 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:52.644592 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:52.648049 (+ 3457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.648849 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.648859 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.648868 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.649045 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.649411 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.649417 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.649422 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.649966 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:52.650230 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:52.650705 (+ 475us) server_negotiation.cc:299] Negotiation successful
0806 04:45:52.651071 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":435,"threads_started":1}
I20260806 04:45:52.654623 14368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.638918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:41646)
0806 04:45:52.639957 (+ 1039us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:52.640005 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:52.640157 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:52.640612 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:52.640620 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:52.641227 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:52.641466 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:52.641474 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.642485 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.642490 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:52.643925 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:52.643937 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.644914 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.644919 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:52.645059 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.645751 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:52.645770 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:52.648438 (+ 2668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:52.651807 (+ 3369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:52.651817 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:52.651824 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:52.652458 (+ 634us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:52.652886 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:52.652890 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:52.652896 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:52.653070 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:52.653637 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:52.653644 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:52.653855 (+ 211us) client_negotiation.cc:769] Sending connection context
0806 04:45:52.654031 (+ 176us) client_negotiation.cc:240] Negotiation successful
0806 04:45:52.654254 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":794,"thread_start_us":641,"threads_started":1}
I20260806 04:45:52.654778 14367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.638937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41646 (local address 127.7.113.254:41047)
0806 04:45:52.639460 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:52.639467 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:52.640246 (+ 779us) server_negotiation.cc:407] Connection header received
0806 04:45:52.640350 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:52.640354 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:52.640430 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:52.640548 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:52.641622 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.642345 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.644075 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.644715 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.644846 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.648607 (+ 3761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:52.648612 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:52.648616 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:52.648649 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:52.651672 (+ 3023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.652613 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.652620 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.652624 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.652766 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.653175 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.653178 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.653180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.653503 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:52.653669 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:52.654199 (+ 530us) server_negotiation.cc:299] Negotiation successful
0806 04:45:52.654437 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":240,"threads_started":1}
I20260806 04:45:52.656391 14363 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:45:52 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991552, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.253@KRBTEST.COM for oryx/127.7.113.253@KRBTEST.COM
I20260806 04:45:52.668218 14368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.657088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:40771 (local address 127.0.0.1:59916)
0806 04:45:52.657290 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:52.657309 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:52.657417 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:52.657707 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:52.657711 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:52.658070 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:52.658193 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:52.658201 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.659153 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.659158 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:52.659964 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:52.659974 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.660686 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.660692 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:52.660946 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.661438 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:52.661453 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:52.663279 (+ 1826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:52.665902 (+ 2623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:52.665906 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:52.665911 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:52.666265 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:52.666629 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:52.666634 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:52.666637 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:52.666764 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:52.667267 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:52.667272 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:52.667415 (+ 143us) client_negotiation.cc:769] Sending connection context
0806 04:45:52.667553 (+ 138us) client_negotiation.cc:240] Negotiation successful
0806 04:45:52.667846 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":54}
I20260806 04:45:52.668298 14366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.657217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59916 (local address 127.7.113.253:40771)
0806 04:45:52.657381 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:52.657386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:52.657402 (+ 16us) server_negotiation.cc:407] Connection header received
0806 04:45:52.657551 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:52.657554 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:52.657601 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:52.657691 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:52.658319 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.659017 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.660096 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.660519 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.660658 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.663450 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:52.663457 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:52.663467 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:52.663493 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:52.665759 (+ 2266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.666386 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.666394 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.666398 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.666514 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.666872 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.666879 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.666883 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.667152 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:52.667301 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:52.667638 (+ 337us) server_negotiation.cc:299] Negotiation successful
0806 04:45:52.667969 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":152,"server-negotiator.queue_time_us":67}
I20260806 04:45:52.672940 14363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: Bootstrap starting.
I20260806 04:45:52.675910 14363 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:52.677014 14363 log.cc:824] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:52.679570 14363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: No bootstrap required, opened a new log
I20260806 04:45:52.686470 14363 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } }
I20260806 04:45:52.686781 14363 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:52.686880 14363 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae6926d5ce374b189a76c42492abe2f7, State: Initialized, Role: FOLLOWER
I20260806 04:45:52.687486 14363 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } }
I20260806 04:45:52.688424 14370 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } } }
I20260806 04:45:52.688792 14370 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:45:52.689567 14363 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 04:45:52.698544 14381 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 04:45:52.698678 14381 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 04:45:52.701601 14296 master_runner.cc:428] Detected that this master ae6926d5ce374b189a76c42492abe2f7 is joining an existing cluster
I20260806 04:45:52.701711 14296 master_runner.cc:432] Initiating AddMaster RPC to add 127.7.113.253:40771
I20260806 04:45:52.730684 14366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.705632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59920 (local address 127.7.113.253:40771)
0806 04:45:52.705876 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:52.705882 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:52.713414 (+ 7532us) server_negotiation.cc:407] Connection header received
0806 04:45:52.713959 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:52.713966 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:52.714047 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:52.714112 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:52.715571 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.716823 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.718993 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.719870 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.719945 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.723205 (+ 3260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:52.723214 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:52.723221 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:52.723264 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:52.727147 (+ 3883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.727951 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.727957 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.727960 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.728083 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.728856 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.728861 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.728865 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.729266 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:52.729412 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:52.729985 (+ 573us) server_negotiation.cc:299] Negotiation successful
0806 04:45:52.730254 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 04:45:52.732040 14388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.705709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:40771 (local address 127.0.0.1:59920)
0806 04:45:52.713311 (+ 7602us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:52.713334 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:52.713804 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:52.714324 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:52.714330 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:52.715010 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:52.715428 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:52.715444 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.717045 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.717053 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:52.718819 (+ 1766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:52.718837 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.720170 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.720173 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:52.720446 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.721718 (+ 1272us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:52.721741 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:52.722994 (+ 1253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:52.727300 (+ 4306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:52.727304 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:52.727308 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:52.727828 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:52.728239 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:52.728244 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:52.728248 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:52.728715 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:52.729506 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:52.729510 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:52.729671 (+ 161us) client_negotiation.cc:769] Sending connection context
0806 04:45:52.731273 (+ 1602us) client_negotiation.cc:240] Negotiation successful
0806 04:45:52.731583 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7422,"thread_start_us":15182,"threads_started":1}
I20260806 04:45:52.736599 14367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.705465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41660 (local address 127.7.113.254:41047)
0806 04:45:52.705686 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:52.705695 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:52.721545 (+ 15850us) server_negotiation.cc:407] Connection header received
0806 04:45:52.721767 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:52.721775 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:52.721884 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:52.721957 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:52.723326 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.724481 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.726794 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.727480 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.727576 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.730070 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:52.730076 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:52.730081 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:52.730125 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:52.733982 (+ 3857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.734637 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.734644 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.734647 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.734813 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.735164 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.735169 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.735173 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.735447 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:52.735603 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:52.736023 (+ 420us) server_negotiation.cc:299] Negotiation successful
0806 04:45:52.736239 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 04:45:52.736691 14387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.706220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:41660)
0806 04:45:52.721276 (+ 15056us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:52.721303 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:52.721572 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:52.722205 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:52.722212 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:52.722852 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:52.723149 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:52.723160 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.724702 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.724714 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:52.726585 (+ 1871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:52.726604 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.727906 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.727915 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:52.728087 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.728671 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:52.728702 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:52.729865 (+ 1163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:52.734115 (+ 4250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:52.734122 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:52.734125 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:52.734469 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:52.734934 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:52.734937 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:52.734939 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:52.735056 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:52.735577 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:52.735581 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:52.735758 (+ 177us) client_negotiation.cc:769] Sending connection context
0806 04:45:52.735918 (+ 160us) client_negotiation.cc:240] Negotiation successful
0806 04:45:52.736227 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14865,"thread_start_us":7196,"threads_started":1}
WARNING: no policy specified for oryx/127.7.113.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.113.252@KRBTEST.COM" created.
Aug 06 04:45:52 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991550, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.254@KRBTEST.COM for oryx/127.7.113.253@KRBTEST.COM
I20260806 04:45:52.761451 14366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.743007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59928 (local address 127.7.113.253:40771)
0806 04:45:52.743235 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:52.743242 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:52.743860 (+ 618us) server_negotiation.cc:407] Connection header received
0806 04:45:52.744123 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:52.744127 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:52.744195 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:52.744333 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:52.746223 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.747696 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.749649 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.750477 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.750672 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.754838 (+ 4166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:52.754847 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:52.754858 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:52.754918 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:52.758539 (+ 3621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.759254 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.759260 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.759266 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.759412 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.759849 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.759855 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.759858 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.760179 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:52.760377 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:52.760833 (+ 456us) server_negotiation.cc:299] Negotiation successful
0806 04:45:52.761070 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 04:45:52.761510 14390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.742970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:40771 (local address 127.0.0.1:59928)
0806 04:45:52.743705 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:52.743747 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:52.743928 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:52.744382 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:52.744389 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:52.745670 (+ 1281us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:52.745955 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:52.745970 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.747872 (+ 1902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.747878 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:52.749490 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:52.749505 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.750710 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.750717 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:52.750914 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.751685 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:52.751710 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:52.754590 (+ 2880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:52.758677 (+ 4087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:52.758691 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:52.758699 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:52.759112 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:52.759526 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:52.759532 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:52.759536 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:52.759708 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:52.760341 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:52.760350 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:52.760545 (+ 195us) client_negotiation.cc:769] Sending connection context
0806 04:45:52.760738 (+ 193us) client_negotiation.cc:240] Negotiation successful
0806 04:45:52.761066 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":352,"threads_started":1}
I20260806 04:45:52.763613 13828 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.7.113.253:40771: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7"
member_type: NON_VOTER
last_known_addr {
host: "127.7.113.253"
port: 40771
}
attrs {
promote: true
}
}
dest_uuid: "2abfd07f6b904abe93be3f40932d6c70"
cas_config_opid_index: -1
I20260806 04:45:52.764891 13828 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: NON_VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: true } }
I20260806 04:45:52.774730 14394 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER ae6926d5ce374b189a76c42492abe2f7 (127.7.113.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: NON_VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: true } } }
I20260806 04:45:52.776206 14338 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:52.779644 14394 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.7.113.253:40771
I20260806 04:45:52.780362 14393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: NON_VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: true } } }
I20260806 04:45:52.780699 14296 master.cc:537] Master@127.7.113.253:40771 shutting down...
I20260806 04:45:52.780757 14393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:52.781049 14338 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 FOLLOWER]: Refusing update from remote peer 2abfd07f6b904abe93be3f40932d6c70: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260806 04:45:52.782037 14394 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: NON_VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 04:45:52.785527 13812 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.113.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.252.keytab.
Entry for principal oryx/127.7.113.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.252.keytab.
I20260806 04:45:52.792191 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.252:36953
--webserver_interface=127.7.113.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.252.keytab
--principal=oryx/127.7.113.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:42843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:41047,127.7.113.253:40771,127.7.113.252:36953
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:45:52.796481 13812 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 -> Peer ae6926d5ce374b189a76c42492abe2f7 (127.7.113.253:40771): Couldn't send request to peer ae6926d5ce374b189a76c42492abe2f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 04:45:52.805087 14296 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:52.805531 14296 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:52.805711 14296 tablet_replica.cc:330] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: stopping tablet replica
I20260806 04:45:52.814122 14296 master.cc:552] Master@127.7.113.253:40771 shutdown complete.
I20260806 04:45:52.814302 14296 master_runner.cc:305] Clearing existing system tablet
I20260806 04:45:52.814884 14296 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:52.815024 14296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:52.818341 14296 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 04:45:52.820307 14399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:52.820627 14296 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:52.820901 14296 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 04:45:52.821018 14296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/wal
uuid: "ae6926d5ce374b189a76c42492abe2f7"
format_stamp: "Formatted at 2026-08-06 04:45:52 on dist-test-slave-0b58"
server_key: "7d19616f3699379f536e7ae61b574871"
server_key_iv: "fb814e26d8ba27a91755c281bc372143"
server_key_version: "encryptionkey@0"
I20260806 04:45:52.827056 14296 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:52.834133 14296 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 04:45:52.834367 14296 log.cc:1196] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260806 04:45:52.834851 14296 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: Deleting consensus metadata
I20260806 04:45:52.835142 14296 master_runner.cc:315] Copying system tablet from 127.7.113.254:41047
I20260806 04:45:52.837870 14296 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.113.254:41047
I20260806 04:45:52.860145 14367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.838854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41676 (local address 127.7.113.254:41047)
0806 04:45:52.839048 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:52.839055 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:52.844947 (+ 5892us) server_negotiation.cc:407] Connection header received
0806 04:45:52.845160 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:52.845168 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:52.845271 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:52.845395 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:52.846625 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.847802 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.849714 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.850388 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.850537 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.853036 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:52.853044 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:52.853050 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:52.853095 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:52.856816 (+ 3721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.857759 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.857765 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.857768 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.857928 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:52.858417 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:52.858422 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:52.858426 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:52.858826 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:52.858997 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:52.859514 (+ 517us) server_negotiation.cc:299] Negotiation successful
0806 04:45:52.859775 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 04:45:52.860525 14405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:52.838724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:41676)
0806 04:45:52.844771 (+ 6047us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:52.844796 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:52.844994 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:52.845477 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:52.845482 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:52.846108 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:52.846430 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:52.846445 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.847978 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.847985 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:52.849539 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:52.849558 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:52.850570 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:52.850577 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:52.850766 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:52.851557 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:52.851582 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:52.852786 (+ 1204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:52.857007 (+ 4221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:52.857015 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:52.857021 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:52.857605 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:52.858059 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:52.858064 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:52.858068 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:52.858258 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:52.858985 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:52.858991 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:52.859190 (+ 199us) client_negotiation.cc:769] Sending connection context
0806 04:45:52.859353 (+ 163us) client_negotiation.cc:240] Negotiation successful
0806 04:45:52.859696 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5877,"thread_start_us":5746,"threads_started":1}
I20260806 04:45:52.861682 13849 tablet_copy_service.cc:140] P 2abfd07f6b904abe93be3f40932d6c70: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer ae6926d5ce374b189a76c42492abe2f7 ({username='oryx', principal='oryx/127.7.113.253@KRBTEST.COM'} at 127.0.0.1:41676)
I20260806 04:45:52.862000 13849 tablet_copy_service.cc:161] P 2abfd07f6b904abe93be3f40932d6c70: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer ae6926d5ce374b189a76c42492abe2f7 at {username='oryx', principal='oryx/127.7.113.253@KRBTEST.COM'} at 127.0.0.1:41676: session id = ae6926d5ce374b189a76c42492abe2f7-00000000000000000000000000000000
I20260806 04:45:52.866828 13849 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 04:45:52.869592 14296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 04:45:52.876766 14296 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: tablet copy: Starting download of 0 data blocks...
I20260806 04:45:52.877118 14296 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: tablet copy: Starting download of 1 WAL segments...
I20260806 04:45:52.880497 14296 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 04:45:52.885102 13849 tablet_copy_service.cc:342] P 2abfd07f6b904abe93be3f40932d6c70: Request end of tablet copy session ae6926d5ce374b189a76c42492abe2f7-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.7.113.253@KRBTEST.COM'} at 127.0.0.1:41676
I20260806 04:45:52.885342 13849 tablet_copy_service.cc:433] P 2abfd07f6b904abe93be3f40932d6c70: ending tablet copy session ae6926d5ce374b189a76c42492abe2f7-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer ae6926d5ce374b189a76c42492abe2f7
I20260806 04:45:52.897977 14296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:52.900846 14406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:52.902156 14407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:52.912472 14409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:52.912810 14296 server_base.cc:1034] running on GCE node
I20260806 04:45:52.913132 14296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:52.913846 14296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:52.915093 14296 hybrid_clock.cc:648] HybridClock initialized: now 1785991552915003 us; error 50 us; skew 500 ppm
I20260806 04:45:52.915314 14296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:52 dist-test-slave-0b58 krb5kdc[13783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991552, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:52.917779 14296 init.cc:377] Logged in from keytab as oryx/127.7.113.253@KRBTEST.COM (short username oryx)
I20260806 04:45:52.921198 14296 webserver.cc:460] Webserver started at http://127.7.113.253:43453/ using document root <none> and password file <none>
I20260806 04:45:52.921581 14296 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:52.921676 14296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:52.924955 14296 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260806 04:45:52.927052 14416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:52.927595 14296 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s
I20260806 04:45:52.927753 14296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/wal
uuid: "ae6926d5ce374b189a76c42492abe2f7"
format_stamp: "Formatted at 2026-08-06 04:45:52 on dist-test-slave-0b58"
server_key: "7d19616f3699379f536e7ae61b574871"
server_key_iv: "fb814e26d8ba27a91755c281bc372143"
server_key_version: "encryptionkey@0"
I20260806 04:45:52.927918 14296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:52.950212 14296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:52.954463 14296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:52.980444 14296 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.253:40771
I20260806 04:45:52.980625 14467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.253:40771 every 8 connection(s)
I20260806 04:45:52.981539 14296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-1/data/info.pb
I20260806 04:45:52.986716 14468 sys_catalog.cc:263] Verifying existing consensus state
I20260806 04:45:52.990527 14468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: Bootstrap starting.
I20260806 04:45:53.007467 14468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 04:45:53.008023 14468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: Bootstrap complete.
I20260806 04:45:53.009202 14468 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: NON_VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: true } }
I20260806 04:45:53.009481 14468 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ae6926d5ce374b189a76c42492abe2f7, State: Initialized, Role: LEARNER
I20260806 04:45:53.009841 14468 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: NON_VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: true } }
I20260806 04:45:53.011140 14468 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:53.010777 14471 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: NON_VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: true } } }
I20260806 04:45:53.011447 14471 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: This master's current role is: LEARNER
I20260806 04:45:53.030747 14482 catalog_manager.cc:1259] Loaded cluster ID: 888aec365cc44d21aeeb9bcb509691e9
I20260806 04:45:53.030942 14482 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: loading cluster ID for follower catalog manager: success
I20260806 04:45:53.035559 14482 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: acquiring CA information for follower catalog manager: success
I20260806 04:45:53.038333 14482 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 04:45:53.097126 14291 heartbeater.cc:503] Master 127.7.113.254:41047 was elected leader, sending a full tablet report...
W20260806 04:45:53.204721 14397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:53.204996 14397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:53.205085 14397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:53.213156 14397 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:45:53.213270 14397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:53.213315 14397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:53.213371 14397 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:45:53.213414 14397 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:45:53.223405 14397 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:42843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:41047,127.7.113.253:40771,127.7.113.252:36953
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.252.keytab
--principal=oryx/127.7.113.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.252:36953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.113.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:53.224756 14397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:53.226045 14397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:53.238345 14487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:53.238296 14490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:53.238231 14488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:53.239442 14397 server_base.cc:1034] running on GCE node
I20260806 04:45:53.240222 14397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:53.241629 14397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:53.242866 14397 hybrid_clock.cc:648] HybridClock initialized: now 1785991553242833 us; error 43 us; skew 500 ppm
I20260806 04:45:53.243213 14397 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:53 dist-test-slave-0b58 krb5kdc[13783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991553, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:53.246311 14397 init.cc:377] Logged in from keytab as oryx/127.7.113.252@KRBTEST.COM (short username oryx)
I20260806 04:45:53.247794 14397 webserver.cc:460] Webserver started at http://127.7.113.252:45785/ using document root <none> and password file <none>
I20260806 04:45:53.248577 14397 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:53.248721 14397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:53.249032 14397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:45:53.251999 14397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/data/instance:
uuid: "1296b6a5ecd24da1b5597846dfd68400"
format_stamp: "Formatted at 2026-08-06 04:45:53 on dist-test-slave-0b58"
server_key: "2a95a638e3eb6b9b617dd3996d26a656"
server_key_iv: "856e9a204e27466aa9e18522dda80747"
server_key_version: "encryptionkey@0"
I20260806 04:45:53.252874 14397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/wal/instance:
uuid: "1296b6a5ecd24da1b5597846dfd68400"
format_stamp: "Formatted at 2026-08-06 04:45:53 on dist-test-slave-0b58"
server_key: "2a95a638e3eb6b9b617dd3996d26a656"
server_key_iv: "856e9a204e27466aa9e18522dda80747"
server_key_version: "encryptionkey@0"
I20260806 04:45:53.257920 14397 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:45:53.261345 14497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:53.262712 14397 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 04:45:53.262883 14397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/wal
uuid: "1296b6a5ecd24da1b5597846dfd68400"
format_stamp: "Formatted at 2026-08-06 04:45:53 on dist-test-slave-0b58"
server_key: "2a95a638e3eb6b9b617dd3996d26a656"
server_key_iv: "856e9a204e27466aa9e18522dda80747"
server_key_version: "encryptionkey@0"
I20260806 04:45:53.263067 14397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:53.282168 14397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:53.286094 14397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:53.286435 14397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:53.305281 14397 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.252:36953
I20260806 04:45:53.305318 14548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.252:36953 every 8 connection(s)
I20260806 04:45:53.306752 14397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/data/info.pb
I20260806 04:45:53.310951 14549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:53.316537 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 14397
I20260806 04:45:53.318166 14549 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:45:53 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991553, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.252@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
Aug 06 04:45:53 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.113.252@KRBTEST.COM
I20260806 04:45:53.338506 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.329918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:40771 (local address 127.0.0.1:59936)
0806 04:45:53.330378 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:53.330399 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:53.330523 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:53.331633 (+ 1110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:53.331640 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:53.331675 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:53.331997 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.332010 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.333794 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.333802 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.336117 (+ 2315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.336137 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.337526 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.337532 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.337745 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.337805 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 04:45:53.337899 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 04:45:53.338104 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":6,"thread_start_us":230,"threads_started":1}
I20260806 04:45:53.338768 14367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.320963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41692 (local address 127.7.113.254:41047)
0806 04:45:53.321119 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:53.321124 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:53.321863 (+ 739us) server_negotiation.cc:407] Connection header received
0806 04:45:53.322270 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:53.322278 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:53.322366 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:53.322470 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:53.323739 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.324519 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.326000 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.326440 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.326571 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.331685 (+ 5114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:53.331692 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:53.331697 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:53.331747 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:53.334987 (+ 3240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.335790 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.335819 (+ 29us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.335823 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.335978 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.336525 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.336529 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.336532 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.336931 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:53.337089 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:53.337964 (+ 875us) server_negotiation.cc:299] Negotiation successful
0806 04:45:53.338277 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":55}
I20260806 04:45:53.339288 14556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.330192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59936 (local address 127.7.113.253:40771)
0806 04:45:53.330792 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:53.330799 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:53.330824 (+ 25us) server_negotiation.cc:407] Connection header received
0806 04:45:53.330898 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:53.330905 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:53.331001 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:53.331345 (+ 344us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:53.332159 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.333637 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.336340 (+ 2703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.337350 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.337496 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.337717 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:53.338749 (+ 1032us) server_negotiation.cc:299] Negotiation successful
0806 04:45:53.338902 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":306,"threads_started":1}
I20260806 04:45:53.340385 14553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.320909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:41692)
0806 04:45:53.321579 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:53.321644 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:53.322056 (+ 412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:53.322538 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:53.322544 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:53.323218 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:53.323571 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.323586 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.324668 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.324680 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.325857 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.325869 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.326666 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.326673 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.326951 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.327687 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:53.327713 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:53.331446 (+ 3733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:53.335115 (+ 3669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.335128 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.335138 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.335612 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.336104 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.336108 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.336112 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.336399 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.337077 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:53.337085 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:53.337516 (+ 431us) client_negotiation.cc:769] Sending connection context
0806 04:45:53.337846 (+ 330us) client_negotiation.cc:240] Negotiation successful
0806 04:45:53.338331 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":331,"threads_started":1}
I20260806 04:45:53.340405 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.318732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58730 (local address 127.7.113.252:36953)
0806 04:45:53.319509 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:53.319520 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:53.319560 (+ 40us) server_negotiation.cc:407] Connection header received
0806 04:45:53.321927 (+ 2367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:53.321955 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:53.322173 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:53.322517 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:53.324014 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.325206 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.326684 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.327196 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.327338 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.332733 (+ 5395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:53.332744 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:53.332783 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:53.332832 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:53.336569 (+ 3737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.337407 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.337415 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.337419 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.337582 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.338058 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.338062 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.338066 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.338509 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:53.338795 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:53.339428 (+ 633us) server_negotiation.cc:299] Negotiation successful
0806 04:45:53.339661 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":369,"threads_started":1}
I20260806 04:45:53.340368 14443 raft_consensus.cc:1203] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260806 04:45:53.341663 14471 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2abfd07f6b904abe93be3f40932d6c70. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: NON_VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: true } } }
I20260806 04:45:53.341917 14471 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: This master's current role is: LEARNER
I20260806 04:45:53.342561 14549 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:45:53 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991553, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.252@KRBTEST.COM for oryx/127.7.113.253@KRBTEST.COM
I20260806 04:45:53.354825 14553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.343509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:40771 (local address 127.0.0.1:59940)
0806 04:45:53.343681 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:53.343695 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:53.343800 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:53.344153 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:53.344157 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:53.344552 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:53.344680 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.344688 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.345645 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.345650 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.346588 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.346599 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.347301 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.347315 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.347508 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.347986 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:53.348003 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:53.349932 (+ 1929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:53.352904 (+ 2972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.352908 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.352910 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.353264 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.353616 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.353619 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.353621 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.353744 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.354175 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:53.354179 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:53.354291 (+ 112us) client_negotiation.cc:769] Sending connection context
0806 04:45:53.354395 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 04:45:53.354588 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 04:45:53.354910 14556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.343713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59940 (local address 127.7.113.253:40771)
0806 04:45:53.343913 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:53.343918 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:53.343933 (+ 15us) server_negotiation.cc:407] Connection header received
0806 04:45:53.343979 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:53.343983 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:53.344034 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:53.344131 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:53.344823 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.345512 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.346725 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.347148 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.347282 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.350091 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:53.350096 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:53.350099 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:53.350130 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:53.352790 (+ 2660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.353395 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.353398 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.353400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.353524 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.353842 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.353845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.353847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.354081 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:53.354189 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:53.354479 (+ 290us) server_negotiation.cc:299] Negotiation successful
0806 04:45:53.354642 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 04:45:53.355921 14549 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:45:53 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991553, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.252@KRBTEST.COM for oryx/127.7.113.252@KRBTEST.COM
I20260806 04:45:53.367769 14553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.356720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:36953 (local address 127.0.0.1:58744)
0806 04:45:53.356981 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:53.357004 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:53.357121 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:53.357416 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:53.357420 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:53.357786 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:53.357916 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.357923 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.358834 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.358839 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.359677 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.359687 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.360395 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.360401 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.360615 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.361062 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:53.361076 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:53.362996 (+ 1920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:53.365628 (+ 2632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.365632 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.365634 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.366002 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.366414 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.366417 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.366420 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.366560 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.367029 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:53.367034 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:53.367204 (+ 170us) client_negotiation.cc:769] Sending connection context
0806 04:45:53.367318 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 04:45:53.367489 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 04:45:53.368019 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.356696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58744 (local address 127.7.113.252:36953)
0806 04:45:53.356912 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:53.356918 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:53.357067 (+ 149us) server_negotiation.cc:407] Connection header received
0806 04:45:53.357242 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:53.357246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:53.357307 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:53.357400 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:53.358047 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.358711 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.359823 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.360223 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.360391 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.363163 (+ 2772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:53.363168 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:53.363171 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:53.363198 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:53.365513 (+ 2315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.366180 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.366185 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.366187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.366317 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.366649 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.366652 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.366654 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.366899 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:53.367034 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:53.367408 (+ 374us) server_negotiation.cc:299] Negotiation successful
0806 04:45:53.367655 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":72}
I20260806 04:45:53.372682 14549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: Bootstrap starting.
I20260806 04:45:53.375702 14549 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:53.376796 14549 log.cc:824] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:53.379334 14549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: No bootstrap required, opened a new log
I20260806 04:45:53.386458 14549 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } }
I20260806 04:45:53.386780 14549 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:53.386907 14549 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1296b6a5ecd24da1b5597846dfd68400, State: Initialized, Role: FOLLOWER
I20260806 04:45:53.387452 14549 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } }
I20260806 04:45:53.388363 14558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } } }
I20260806 04:45:53.388720 14558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:45:53.389315 14549 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 04:45:53.399748 14569 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 04:45:53.399902 14569 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 04:45:53.403178 14397 master_runner.cc:428] Detected that this master 1296b6a5ecd24da1b5597846dfd68400 is joining an existing cluster
I20260806 04:45:53.403321 14397 master_runner.cc:432] Initiating AddMaster RPC to add 127.7.113.252:36953
I20260806 04:45:53.436672 14367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.407190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41708 (local address 127.7.113.254:41047)
0806 04:45:53.407387 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:53.407394 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:53.418260 (+ 10866us) server_negotiation.cc:407] Connection header received
0806 04:45:53.418609 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:53.418618 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:53.418725 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:53.418810 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:53.420836 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.422428 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.425138 (+ 2710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.425821 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.425975 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.429147 (+ 3172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:53.429154 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:53.429159 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:53.429198 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:53.432804 (+ 3606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.433943 (+ 1139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.433949 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.433952 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.434112 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.434616 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.434622 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.434625 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.435026 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:53.435163 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:53.435956 (+ 793us) server_negotiation.cc:299] Negotiation successful
0806 04:45:53.436224 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 04:45:53.437858 14576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.407453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:41708)
0806 04:45:53.418109 (+ 10656us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:53.418136 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:53.418407 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:53.419087 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:53.419095 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:53.420083 (+ 988us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:53.420597 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.420614 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.422661 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.422669 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.424977 (+ 2308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.424991 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.426276 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.426282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.426732 (+ 450us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.427541 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:53.427565 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:53.428916 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:53.433002 (+ 4086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.433013 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.433019 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.433788 (+ 769us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.434264 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.434274 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.434277 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.434480 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.435250 (+ 770us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:53.435257 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:53.435473 (+ 216us) client_negotiation.cc:769] Sending connection context
0806 04:45:53.436961 (+ 1488us) client_negotiation.cc:240] Negotiation successful
0806 04:45:53.437333 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10462,"thread_start_us":16226,"threads_started":1}
I20260806 04:45:53.442139 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.407537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58752 (local address 127.7.113.252:36953)
0806 04:45:53.407998 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:53.408004 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:53.424513 (+ 16509us) server_negotiation.cc:407] Connection header received
0806 04:45:53.425233 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:53.425238 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:53.425316 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:53.425419 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:53.426901 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.428118 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.430265 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.431027 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.431137 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.435103 (+ 3966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:53.435108 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:53.435112 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:53.435144 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:53.439050 (+ 3906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.439916 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.439922 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.439927 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.440076 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.440486 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.440490 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.440493 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.440828 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:53.440938 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:53.441324 (+ 386us) server_negotiation.cc:299] Negotiation successful
0806 04:45:53.441654 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":145,"server-negotiator.queue_time_us":325}
I20260806 04:45:53.442741 14556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.408144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59956 (local address 127.7.113.253:40771)
0806 04:45:53.408400 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:53.408409 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:53.424208 (+ 15799us) server_negotiation.cc:407] Connection header received
0806 04:45:53.424755 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:53.424761 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:53.424857 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:53.424929 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:53.426645 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.427724 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.430178 (+ 2454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.431028 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.431254 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.434014 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:53.434021 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:53.434026 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:53.434066 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:53.437729 (+ 3663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.439181 (+ 1452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.439186 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.439190 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.439338 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.439899 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.439906 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.439912 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.440251 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:53.440409 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:53.441747 (+ 1338us) server_negotiation.cc:299] Negotiation successful
0806 04:45:53.442001 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 04:45:53.442955 14575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.407932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:36953 (local address 127.0.0.1:58752)
0806 04:45:53.424428 (+ 16496us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:53.424443 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:53.425105 (+ 662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:53.425567 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:53.425574 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:53.426367 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:53.426736 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.426748 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.428392 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.428399 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.430123 (+ 1724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.430140 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.431503 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.431512 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.431699 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.433453 (+ 1754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:53.433475 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:53.434922 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:53.439199 (+ 4277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.439203 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.439206 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.439786 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.440195 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.440201 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.440205 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.440371 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.440986 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:53.440989 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:53.441090 (+ 101us) client_negotiation.cc:769] Sending connection context
0806 04:45:53.441229 (+ 139us) client_negotiation.cc:240] Negotiation successful
0806 04:45:53.442388 (+ 1159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16364,"mutex_wait_us":28,"spinlock_wait_cycles":27904,"thread_start_us":15492,"threads_started":1}
I20260806 04:45:53.444399 14577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.407486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:40771 (local address 127.0.0.1:59956)
0806 04:45:53.424102 (+ 16616us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:53.424129 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:53.424602 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:53.425292 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:53.425297 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:53.426071 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:53.426435 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.426452 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.427942 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.427947 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.429965 (+ 2018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.429979 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.431583 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.431591 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.431813 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.432510 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:53.432532 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:53.433780 (+ 1248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:53.438366 (+ 4586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.438372 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.438375 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.439034 (+ 659us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.439492 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.439497 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.439500 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.439726 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.440491 (+ 765us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:53.440496 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:53.440736 (+ 240us) client_negotiation.cc:769] Sending connection context
0806 04:45:53.443548 (+ 2812us) client_negotiation.cc:240] Negotiation successful
0806 04:45:53.443885 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16439,"mutex_wait_us":36,"thread_start_us":9866,"threads_started":1}
I20260806 04:45:53.446350 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 13890
Aug 06 04:45:53 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991550, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.254@KRBTEST.COM for oryx/127.7.113.252@KRBTEST.COM
Aug 06 04:45:53 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.113.193@KRBTEST.COM
I20260806 04:45:53.465030 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.444444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:36953 (local address 127.0.0.1:58768)
0806 04:45:53.444777 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:53.444828 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:53.444927 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:53.445882 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:53.445887 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:53.446355 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:53.446571 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.446585 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.448067 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.448072 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.449455 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.449467 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.450426 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.450432 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.450610 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.451258 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:53.451280 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:53.454224 (+ 2944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:53.462054 (+ 7830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.462060 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.462065 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.462645 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.463093 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.463099 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.463103 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.463273 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.463959 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:53.463964 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:53.464165 (+ 201us) client_negotiation.cc:769] Sending connection context
0806 04:45:53.464325 (+ 160us) client_negotiation.cc:240] Negotiation successful
0806 04:45:53.464616 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219}
I20260806 04:45:53.466197 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.445306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58768 (local address 127.7.113.252:36953)
0806 04:45:53.445470 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:53.445476 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:53.445492 (+ 16us) server_negotiation.cc:407] Connection header received
0806 04:45:53.445573 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:53.445578 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:53.445689 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:53.446732 (+ 1043us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:53.446972 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.447796 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.449604 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.450257 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.454400 (+ 4143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.454626 (+ 226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:53.454634 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:53.454641 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:53.454682 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:53.461893 (+ 7211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.462822 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.462828 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.462832 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.462961 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.463424 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.463429 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.463433 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.463789 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:53.465437 (+ 1648us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:53.465561 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 04:45:53.465782 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 04:45:53.467756 13828 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.7.113.252:36953: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400"
member_type: NON_VOTER
last_known_addr {
host: "127.7.113.252"
port: 36953
}
attrs {
promote: true
}
}
dest_uuid: "2abfd07f6b904abe93be3f40932d6c70"
cas_config_opid_index: 5
I20260806 04:45:53.468881 13828 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: NON_VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: true } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } }
I20260806 04:45:53.470670 14578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.447427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44418 (local address 127.7.113.193:35253)
0806 04:45:53.448303 (+ 876us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:53.448321 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:53.448349 (+ 28us) server_negotiation.cc:407] Connection header received
0806 04:45:53.448414 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:53.448423 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:53.448706 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:53.449029 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:53.450710 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.452345 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.454405 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.455350 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.456081 (+ 731us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.461521 (+ 5440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:53.461537 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:53.461556 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:53.461602 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:53.465902 (+ 4300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.467094 (+ 1192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.467104 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.467108 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.467264 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.467775 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.467780 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.467784 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.468392 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:53.469801 (+ 1409us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:53.469985 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 04:45:53.470259 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":809,"threads_started":1}
I20260806 04:45:53.471096 14554 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 1296b6a5ecd24da1b5597846dfd68400 (127.7.113.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: NON_VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: true } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } } }
I20260806 04:45:53.476830 14015 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:53.477275 14443 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 LEARNER]: Refusing update from remote peer 2abfd07f6b904abe93be3f40932d6c70: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 04:45:53.477861 14554 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.7.113.252:36953
I20260806 04:45:53.478195 14524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:53.478474 14397 master.cc:537] Master@127.7.113.252:36953 shutting down...
I20260806 04:45:53.494256 14579 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: NON_VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260806 04:45:53.495086 14580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: NON_VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: true } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } } }
I20260806 04:45:53.495550 14580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:53.505996 14524 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 1 FOLLOWER]: Refusing update from remote peer 2abfd07f6b904abe93be3f40932d6c70: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 04:45:53.507035 14579 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 04:45:53.513943 13814 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 -> Peer 1296b6a5ecd24da1b5597846dfd68400 (127.7.113.252:36953): Couldn't send request to peer 1296b6a5ecd24da1b5597846dfd68400. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 04:45:53.516175 14443 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 1296b6a5ecd24da1b5597846dfd68400 (127.7.113.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: NON_VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: true } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } } }
I20260806 04:45:53.517568 14397 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:53.517995 14397 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:53.518276 14397 tablet_replica.cc:330] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: stopping tablet replica
I20260806 04:45:53.520967 14471 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: NON_VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: true } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } } }
I20260806 04:45:53.521230 14471 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: This master's current role is: LEARNER
I20260806 04:45:53.522164 14554 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70: attempting to promote NON_VOTER ae6926d5ce374b189a76c42492abe2f7 to VOTER
I20260806 04:45:53.523011 14554 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } }
I20260806 04:45:53.525656 14443 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 LEARNER]: Refusing update from remote peer 2abfd07f6b904abe93be3f40932d6c70: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 04:45:53.525998 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.525403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:36953 (local address 127.0.0.1:58776)
0806 04:45:53.525662 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:53.525787 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260806 04:45:53.526664 14580 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260806 04:45:53.526780 14397 master.cc:552] Master@127.7.113.252:36953 shutdown complete.
I20260806 04:45:53.526868 14397 master_runner.cc:305] Clearing existing system tablet
I20260806 04:45:53.527195 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.526721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:36953 (local address 127.0.0.1:58788)
0806 04:45:53.526960 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:53.527051 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260806 04:45:53.527289 14397 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:53.527413 14397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260806 04:45:53.527379 13814 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 -> Peer 1296b6a5ecd24da1b5597846dfd68400 (127.7.113.252:36953): Couldn't send request to peer 1296b6a5ecd24da1b5597846dfd68400. Status: Network error: Client connection negotiation failed: client connection to 127.7.113.252:36953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 04:45:53.529825 14579 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ae6926d5ce374b189a76c42492abe2f7 (127.7.113.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } } }
I20260806 04:45:53.536530 14397 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.002s sys 0.005s
I20260806 04:45:53.536798 14442 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ae6926d5ce374b189a76c42492abe2f7 (127.7.113.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } } }
I20260806 04:45:53.541844 14471 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } } }
I20260806 04:45:53.542203 14471 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:45:53.546752 14587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:53.547137 14397 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:53.547465 14397 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.001s sys 0.009s
I20260806 04:45:53.547583 14397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/wal
uuid: "1296b6a5ecd24da1b5597846dfd68400"
format_stamp: "Formatted at 2026-08-06 04:45:53 on dist-test-slave-0b58"
server_key: "2a95a638e3eb6b9b617dd3996d26a656"
server_key_iv: "856e9a204e27466aa9e18522dda80747"
server_key_version: "encryptionkey@0"
I20260806 04:45:53.553834 14397 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:53.557963 14554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } } }
I20260806 04:45:53.558249 14554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:53.558682 14554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } } }
I20260806 04:45:53.558933 14554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:53.560770 14397 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 04:45:53.560936 14397 log.cc:1196] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260806 04:45:53.561427 14397 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: Deleting consensus metadata
I20260806 04:45:53.561678 14397 master_runner.cc:315] Copying system tablet from 127.7.113.254:41047
I20260806 04:45:53.578295 14397 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: tablet copy: Beginning tablet copy session from remote peer at address 127.7.113.254:41047
I20260806 04:45:53.598057 14367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.579145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41712 (local address 127.7.113.254:41047)
0806 04:45:53.579511 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:53.579521 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:53.584904 (+ 5383us) server_negotiation.cc:407] Connection header received
0806 04:45:53.585131 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:53.585143 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:53.585210 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:53.585317 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:53.586185 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.586923 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.588191 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.588697 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.588839 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.591151 (+ 2312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:53.591158 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:53.591163 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:53.591206 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:53.594262 (+ 3056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.594881 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.594887 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.594890 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.595019 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:53.595408 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:53.595414 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:53.595418 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:53.595721 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:53.595883 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:53.597638 (+ 1755us) server_negotiation.cc:299] Negotiation successful
0806 04:45:53.597846 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260806 04:45:53.598287 14594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:53.579144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:41712)
0806 04:45:53.584785 (+ 5641us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:53.584806 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:53.584976 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:53.585350 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:53.585356 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:53.585798 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:53.586019 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.586028 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.587070 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.587076 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.588045 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:53.588058 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:53.588877 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:53.588883 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:53.589090 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:53.589786 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:53.589804 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:53.590921 (+ 1117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:53.594392 (+ 3471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.594398 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.594402 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.594758 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.595130 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:53.595135 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:53.595139 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:53.595283 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:53.596250 (+ 967us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:53.596255 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:53.596480 (+ 225us) client_negotiation.cc:769] Sending connection context
0806 04:45:53.596625 (+ 145us) client_negotiation.cc:240] Negotiation successful
0806 04:45:53.596981 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5480,"thread_start_us":5321,"threads_started":1}
I20260806 04:45:53.598841 13849 tablet_copy_service.cc:140] P 2abfd07f6b904abe93be3f40932d6c70: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 1296b6a5ecd24da1b5597846dfd68400 ({username='oryx', principal='oryx/127.7.113.252@KRBTEST.COM'} at 127.0.0.1:41712)
I20260806 04:45:53.599001 13849 tablet_copy_service.cc:161] P 2abfd07f6b904abe93be3f40932d6c70: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 1296b6a5ecd24da1b5597846dfd68400 at {username='oryx', principal='oryx/127.7.113.252@KRBTEST.COM'} at 127.0.0.1:41712: session id = 1296b6a5ecd24da1b5597846dfd68400-00000000000000000000000000000000
I20260806 04:45:53.601390 13849 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 04:45:53.602950 14397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 04:45:53.607774 14397 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: tablet copy: Starting download of 0 data blocks...
I20260806 04:45:53.608057 14397 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: tablet copy: Starting download of 1 WAL segments...
I20260806 04:45:53.610560 14397 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 04:45:53.614090 13849 tablet_copy_service.cc:342] P 2abfd07f6b904abe93be3f40932d6c70: Request end of tablet copy session 1296b6a5ecd24da1b5597846dfd68400-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.7.113.252@KRBTEST.COM'} at 127.0.0.1:41712
I20260806 04:45:53.614226 13849 tablet_copy_service.cc:433] P 2abfd07f6b904abe93be3f40932d6c70: ending tablet copy session 1296b6a5ecd24da1b5597846dfd68400-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 1296b6a5ecd24da1b5597846dfd68400
I20260806 04:45:53.624903 14397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:53.627556 14595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:53.629490 14596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:53.634603 14397 server_base.cc:1034] running on GCE node
W20260806 04:45:53.634927 14598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:53.635383 14397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:53.636039 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 13890
I20260806 04:45:53.640493 14397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:53.641705 14397 hybrid_clock.cc:648] HybridClock initialized: now 1785991553641653 us; error 44 us; skew 500 ppm
I20260806 04:45:53.641978 14397 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:53 dist-test-slave-0b58 krb5kdc[13783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991553, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:53.644397 14397 init.cc:377] Logged in from keytab as oryx/127.7.113.252@KRBTEST.COM (short username oryx)
I20260806 04:45:53.645780 14397 webserver.cc:460] Webserver started at http://127.7.113.252:42359/ using document root <none> and password file <none>
I20260806 04:45:53.646162 14397 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:53.646302 14397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:53.649904 14397 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.003s
I20260806 04:45:53.652120 14605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:53.652588 14397 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260806 04:45:53.652707 14397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/wal
uuid: "1296b6a5ecd24da1b5597846dfd68400"
format_stamp: "Formatted at 2026-08-06 04:45:53 on dist-test-slave-0b58"
server_key: "2a95a638e3eb6b9b617dd3996d26a656"
server_key_iv: "856e9a204e27466aa9e18522dda80747"
server_key_version: "encryptionkey@0"
I20260806 04:45:53.652904 14397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:53.659710 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:35253
--local_ip_for_outbound_sockets=127.7.113.193
--tserver_master_addrs=127.7.113.254:41047
--webserver_port=42805
--webserver_interface=127.7.113.193
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.193.keytab
--principal=oryx/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:42843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.113.254:41047,127.7.113.253:40771
--tserver_master_addrs=127.7.113.254:41047,127.7.113.253:40771,127.7.113.252:36953 with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:45:53.681057 14397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:53.685348 14397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:53.712985 14397 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.252:36953
I20260806 04:45:53.713038 14659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.252:36953 every 8 connection(s)
I20260806 04:45:53.714043 14397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/master-2/data/info.pb
I20260806 04:45:53.719458 14660 sys_catalog.cc:263] Verifying existing consensus state
I20260806 04:45:53.724207 14660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: Bootstrap starting.
I20260806 04:45:53.748128 14660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 04:45:53.748716 14660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: Bootstrap complete.
I20260806 04:45:53.749899 14660 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } }
I20260806 04:45:53.750202 14660 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1296b6a5ecd24da1b5597846dfd68400, State: Initialized, Role: LEARNER
I20260806 04:45:53.750461 14660 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } }
I20260806 04:45:53.751596 14660 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:45:53.751367 14663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } } }
I20260806 04:45:53.751906 14663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [sys.catalog]: This master's current role is: LEARNER
I20260806 04:45:53.760344 14674 catalog_manager.cc:1259] Loaded cluster ID: 888aec365cc44d21aeeb9bcb509691e9
I20260806 04:45:53.760475 14674 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: loading cluster ID for follower catalog manager: success
I20260806 04:45:53.762835 14674 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: acquiring CA information for follower catalog manager: success
I20260806 04:45:53.764653 14674 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 04:45:54.028137 14675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.021341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58792 (local address 127.7.113.252:36953)
0806 04:45:54.022100 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:54.022104 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:54.022119 (+ 15us) server_negotiation.cc:407] Connection header received
0806 04:45:54.022181 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:54.022185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:54.022252 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:54.022349 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:54.022908 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.023925 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.026162 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.027075 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.027185 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.027338 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:54.027666 (+ 328us) server_negotiation.cc:299] Negotiation successful
0806 04:45:54.027805 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":479,"threads_started":1}
I20260806 04:45:54.028131 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.021163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:36953 (local address 127.0.0.1:58792)
0806 04:45:54.021368 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:54.021391 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:54.021535 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:54.022420 (+ 885us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:54.022425 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:54.022464 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:54.022716 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:54.022728 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.024088 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.024095 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:54.025985 (+ 1890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:54.026003 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.027273 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.027281 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:54.027487 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.027527 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 04:45:54.027643 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 04:45:54.027799 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 04:45:54.029168 14633 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260806 04:45:54.029779 14663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2abfd07f6b904abe93be3f40932d6c70. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } } }
I20260806 04:45:54.030097 14663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [sys.catalog]: This master's current role is: LEARNER
W20260806 04:45:54.048511 14610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:54.048785 14610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:54.048887 14610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:54.056958 14610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:54.057111 14610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:54.057335 14610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:45:54.067545 14610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:42843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.193.keytab
--principal=oryx/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:35253
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=42805
--tserver_master_addrs=127.7.113.254:41047,127.7.113.253:40771,127.7.113.252:36953
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:54.069388 14610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:54.070632 14610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:54.083837 14683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:54.083814 14681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:54.083921 14680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:54.084550 14610 server_base.cc:1034] running on GCE node
I20260806 04:45:54.085085 14610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:54.085963 14610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:54.087158 14610 hybrid_clock.cc:648] HybridClock initialized: now 1785991554087120 us; error 29 us; skew 500 ppm
I20260806 04:45:54.087466 14610 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:54 dist-test-slave-0b58 krb5kdc[13783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991554, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:54.090538 14610 init.cc:377] Logged in from keytab as oryx/127.7.113.193@KRBTEST.COM (short username oryx)
I20260806 04:45:54.091944 14610 webserver.cc:460] Webserver started at http://127.7.113.193:42805/ using document root <none> and password file <none>
I20260806 04:45:54.092698 14610 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:54.092864 14610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:54.098131 14610 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 04:45:54.101194 14690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:54.102458 14610 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:45:54.102635 14610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "bdbca05291a74430a535417c808f5b56"
format_stamp: "Formatted at 2026-08-06 04:45:50 on dist-test-slave-0b58"
server_key: "807691bf77e180aada18786d1f0286eb"
server_key_iv: "f7de271f4c3d94e0b5f639f00a7d34af"
server_key_version: "encryptionkey@0"
I20260806 04:45:54.103708 14610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:54.123991 14610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:54.128284 14610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:54.128566 14610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:54.129616 14610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:54.130966 14610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:54.131104 14610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:54.131242 14610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:54.131335 14610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:54.167719 14610 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:35253
I20260806 04:45:54.167811 14806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:35253 every 8 connection(s)
I20260806 04:45:54.169296 14610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:45:54.175256 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 14610
I20260806 04:45:54.175665 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 14026
Aug 06 04:45:54 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991554, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.253@KRBTEST.COM
Aug 06 04:45:54 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991554, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.252@KRBTEST.COM
I20260806 04:45:54.209408 14812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.172147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:48799 (local address 127.7.113.253:40771)
0806 04:45:54.187570 (+ 15423us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:54.187576 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:54.187609 (+ 33us) server_negotiation.cc:407] Connection header received
0806 04:45:54.189755 (+ 2146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:54.189761 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:54.189875 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:54.190220 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:54.192358 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.193132 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.195792 (+ 2660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.196465 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.196561 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.201802 (+ 5241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:54.201813 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:54.201820 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:54.201874 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:54.205502 (+ 3628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.206259 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.206268 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.206273 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.206436 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.207023 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.207028 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.207031 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.207457 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:54.207615 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:54.208780 (+ 1165us) server_negotiation.cc:299] Negotiation successful
0806 04:45:54.209001 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15302,"thread_start_us":15464,"threads_started":1}
I20260806 04:45:54.211712 14813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.172837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:40771 (local address 127.7.113.193:48799)
0806 04:45:54.187265 (+ 14428us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:54.187330 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:54.189394 (+ 2064us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:54.190787 (+ 1393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:54.190798 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:54.191561 (+ 763us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:54.192154 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:54.192172 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.193312 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.193318 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:54.195610 (+ 2292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:54.195624 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.196947 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.196955 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:54.197367 (+ 412us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.198250 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:54.198282 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:54.201495 (+ 3213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:54.205631 (+ 4136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:54.205640 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:54.205655 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:54.206078 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:54.206608 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:54.206615 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:54.206621 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:54.206869 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:54.207698 (+ 829us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:54.207706 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:54.208320 (+ 614us) client_negotiation.cc:769] Sending connection context
0806 04:45:54.209625 (+ 1305us) client_negotiation.cc:240] Negotiation successful
0806 04:45:54.210165 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13952,"mutex_wait_us":85,"thread_start_us":16808,"threads_started":1}
I20260806 04:45:54.211826 14675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.174183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:49223 (local address 127.7.113.252:36953)
0806 04:45:54.174456 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:54.174466 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:54.193434 (+ 18968us) server_negotiation.cc:407] Connection header received
0806 04:45:54.193675 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:54.193681 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:54.193771 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:54.193875 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:54.195184 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.196245 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.198295 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.198973 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.199072 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.204452 (+ 5380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:54.204457 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:54.204459 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:54.204491 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:54.207864 (+ 3373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.209134 (+ 1270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.209140 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.209143 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.209289 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.209913 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.209917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.209920 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.210317 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:54.210448 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:54.211185 (+ 737us) server_negotiation.cc:299] Negotiation successful
0806 04:45:54.211412 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 04:45:54.212837 14817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.173485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:36953 (local address 127.7.113.193:49223)
0806 04:45:54.193285 (+ 19800us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:54.193308 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:54.193530 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:54.194052 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:54.194057 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:54.194708 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:54.195002 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:54.195013 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.196463 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.196468 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:54.198093 (+ 1625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:54.198111 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.199385 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.199391 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:54.199624 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.200299 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:54.200332 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:54.204227 (+ 3895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:54.208359 (+ 4132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:54.208363 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:54.208366 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:54.209001 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:54.209431 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:54.209435 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:54.209438 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:54.209753 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:54.210611 (+ 858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:54.210616 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:54.210886 (+ 270us) client_negotiation.cc:769] Sending connection context
0806 04:45:54.212067 (+ 1181us) client_negotiation.cc:240] Negotiation successful
0806 04:45:54.212386 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19648,"mutex_wait_us":26,"thread_start_us":29968,"threads_started":1}
I20260806 04:45:54.213841 14809 heartbeater.cc:347] Connected to a master server at 127.7.113.253:40771
I20260806 04:45:54.214212 14809 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:54.215233 14809 heartbeater.cc:511] Master 127.7.113.253:40771 requested a full tablet report, sending...
Aug 06 04:45:54 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991554, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
I20260806 04:45:54.215996 14807 heartbeater.cc:347] Connected to a master server at 127.7.113.252:36953
I20260806 04:45:54.216099 14807 heartbeater.cc:464] Registering TS with master...
Aug 06 04:45:54 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.113.194@KRBTEST.COM
I20260806 04:45:54.216553 14807 heartbeater.cc:511] Master 127.7.113.252:36953 requested a full tablet report, sending...
I20260806 04:45:54.217793 14433 ts_manager.cc:194] Registered new tserver with Master: bdbca05291a74430a535417c808f5b56 (127.7.113.193:35253)
I20260806 04:45:54.218720 14623 ts_manager.cc:194] Registered new tserver with Master: bdbca05291a74430a535417c808f5b56 (127.7.113.193:35253)
I20260806 04:45:54.223492 14811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.172046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:55575 (local address 127.7.113.254:41047)
0806 04:45:54.202240 (+ 30194us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:54.202246 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:54.203942 (+ 1696us) server_negotiation.cc:407] Connection header received
0806 04:45:54.205091 (+ 1149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:54.205099 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:54.206133 (+ 1034us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:54.208398 (+ 2265us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:54.208609 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.209705 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.211909 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.212600 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.212721 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.217280 (+ 4559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:54.217287 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:54.217291 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:54.217345 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:54.220565 (+ 3220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.221325 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.221329 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.221331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.221491 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.221876 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.221881 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.221885 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.222181 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:54.222314 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:54.222770 (+ 456us) server_negotiation.cc:299] Negotiation successful
0806 04:45:54.223056 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30056,"thread_start_us":30188,"threads_started":1}
I20260806 04:45:54.223476 14814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.172837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.193:55575)
0806 04:45:54.203786 (+ 30949us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:54.203805 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:54.203945 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:54.207169 (+ 3224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:54.207179 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:54.207760 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:54.208161 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:54.208175 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.209953 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.209960 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:54.211731 (+ 1771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:54.211746 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.212790 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.212796 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:54.213010 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.213752 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:54.213775 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:54.216330 (+ 2555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:54.220710 (+ 4380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:54.220717 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:54.220723 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:54.221190 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:54.221613 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:54.221617 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:54.221619 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:54.221755 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:54.222308 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:54.222314 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:54.222462 (+ 148us) client_negotiation.cc:769] Sending connection context
0806 04:45:54.222636 (+ 174us) client_negotiation.cc:240] Negotiation successful
0806 04:45:54.222982 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25685,"thread_start_us":15006,"threads_started":1}
I20260806 04:45:54.224558 14808 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41047
I20260806 04:45:54.224710 14808 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:54.225196 14808 heartbeater.cc:511] Master 127.7.113.254:41047 requested a full tablet report, sending...
I20260806 04:45:54.226449 13828 ts_manager.cc:194] Re-registered known tserver with Master: bdbca05291a74430a535417c808f5b56 (127.7.113.193:35253)
I20260806 04:45:54.226967 14816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.176885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56958 (local address 127.7.113.194:43141)
0806 04:45:54.198687 (+ 21802us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:54.198699 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:54.201535 (+ 2836us) server_negotiation.cc:407] Connection header received
0806 04:45:54.202496 (+ 961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:54.202514 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:54.202851 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:54.203072 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:54.205374 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.207014 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.208870 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.210199 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.210367 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.217666 (+ 7299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:54.217681 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:54.217754 (+ 73us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:54.217812 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:54.221316 (+ 3504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.222062 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.222068 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.222070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.222194 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.224686 (+ 2492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.224693 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.224698 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.225153 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:54.225499 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:54.226091 (+ 592us) server_negotiation.cc:299] Negotiation successful
0806 04:45:54.226475 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21606,"thread_start_us":21190,"threads_started":1}
I20260806 04:45:54.227556 13828 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:55575
I20260806 04:45:54.229503 14152 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:54.314551 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 14026
I20260806 04:45:54.332827 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:43141
--local_ip_for_outbound_sockets=127.7.113.194
--tserver_master_addrs=127.7.113.254:41047
--webserver_port=40167
--webserver_interface=127.7.113.194
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.194.keytab
--principal=oryx/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:42843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.113.254:41047,127.7.113.253:40771
--tserver_master_addrs=127.7.113.254:41047,127.7.113.253:40771,127.7.113.252:36953 with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:45:54.505915 14586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: NON_VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: true } } }
I20260806 04:45:54.506430 14586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:54.508302 14820 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70: attempting to promote NON_VOTER 1296b6a5ecd24da1b5597846dfd68400 to VOTER
I20260806 04:45:54.508893 14820 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } }
I20260806 04:45:54.511044 14442 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 FOLLOWER]: Refusing update from remote peer 2abfd07f6b904abe93be3f40932d6c70: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260806 04:45:54.511758 14633 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 1 LEARNER]: Refusing update from remote peer 2abfd07f6b904abe93be3f40932d6c70: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260806 04:45:54.511868 14821 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260806 04:45:54.512377 14586 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260806 04:45:54.515291 14586 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 1296b6a5ecd24da1b5597846dfd68400 (127.7.113.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } } }
I20260806 04:45:54.515885 14442 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 1296b6a5ecd24da1b5597846dfd68400 (127.7.113.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } } }
I20260806 04:45:54.518488 14586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } } }
I20260806 04:45:54.518733 14586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:54.518963 14586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } } }
I20260806 04:45:54.519155 14586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:54.520089 14820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } } }
I20260806 04:45:54.520401 14820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:54.520654 14633 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 1296b6a5ecd24da1b5597846dfd68400 (127.7.113.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } } }
I20260806 04:45:54.523557 14663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } } }
I20260806 04:45:54.523824 14663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:45:54.524223 14824 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2abfd07f6b904abe93be3f40932d6c70" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } } }
I20260806 04:45:54.524641 14824 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 04:45:54.676906 14819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:54.677186 14819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:54.677289 14819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:54.684428 14819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:54.684532 14819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:54.684643 14819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:45:54.694533 14819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:42843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.194.keytab
--principal=oryx/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:43141
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=40167
--tserver_master_addrs=127.7.113.254:41047,127.7.113.253:40771,127.7.113.252:36953
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:54.695809 14819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:54.697254 14819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:54.710547 14830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:54.710654 14832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:54.711318 14829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:54.717774 14819 server_base.cc:1034] running on GCE node
I20260806 04:45:54.718461 14819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:54.719414 14819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:54.720634 14819 hybrid_clock.cc:648] HybridClock initialized: now 1785991554720586 us; error 38 us; skew 500 ppm
I20260806 04:45:54.720948 14819 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:54 dist-test-slave-0b58 krb5kdc[13783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991554, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:54.724210 14819 init.cc:377] Logged in from keytab as oryx/127.7.113.194@KRBTEST.COM (short username oryx)
I20260806 04:45:54.725732 14819 webserver.cc:460] Webserver started at http://127.7.113.194:40167/ using document root <none> and password file <none>
I20260806 04:45:54.726455 14819 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:54.726642 14819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:54.732012 14819 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:45:54.734567 14839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:54.735824 14819 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:45:54.736021 14819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "d549e48698944b0783d02570ba6e1e86"
format_stamp: "Formatted at 2026-08-06 04:45:51 on dist-test-slave-0b58"
server_key: "8cdc402572a3eb7a37912cedd052ef1f"
server_key_iv: "87d4cb9a0ffaf1dace7fce65e8a2e23f"
server_key_version: "encryptionkey@0"
I20260806 04:45:54.737112 14819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:54.751152 14819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:54.755559 14819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:54.755844 14819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:54.756881 14819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:54.758230 14819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:54.758344 14819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:54.758479 14819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:54.758584 14819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:54.791307 14819 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:43141
I20260806 04:45:54.791414 14953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:43141 every 8 connection(s)
I20260806 04:45:54.792853 14819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:45:54.798931 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 14819
I20260806 04:45:54.799242 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 14162
Aug 06 04:45:54 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.113.195@KRBTEST.COM
I20260806 04:45:54.882964 14964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.800717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43264 (local address 127.7.113.195:33369)
0806 04:45:54.845836 (+ 45119us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:54.845851 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:54.848774 (+ 2923us) server_negotiation.cc:407] Connection header received
0806 04:45:54.848880 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:54.848892 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:54.849218 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:54.849411 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:54.853812 (+ 4401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.856012 (+ 2200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.862688 (+ 6676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.863956 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.864138 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.872945 (+ 8807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:54.872968 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:54.872991 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:54.873051 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:54.878147 (+ 5096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.879215 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.879242 (+ 27us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.879248 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.879453 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.880004 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.880010 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.880013 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.880553 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:54.880890 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:54.882207 (+ 1317us) server_negotiation.cc:299] Negotiation successful
0806 04:45:54.882503 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44849,"thread_start_us":46456,"threads_started":1}
Aug 06 04:45:54 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991554, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.252@KRBTEST.COM
Aug 06 04:45:54 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991554, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
I20260806 04:45:54.884475 14286 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:54.892351 14960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.796889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:34391 (local address 127.7.113.254:41047)
0806 04:45:54.859693 (+ 62804us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:54.859702 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:54.859727 (+ 25us) server_negotiation.cc:407] Connection header received
0806 04:45:54.859809 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:54.859818 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:54.859936 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:54.866030 (+ 6094us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:54.866289 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.867740 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.875436 (+ 7696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.876382 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.876542 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.885053 (+ 8511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:54.885059 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:54.885062 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:54.885125 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:54.888840 (+ 3715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.889642 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.889648 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.889652 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.889834 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.890550 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.890554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.890557 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.890929 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:54.891061 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:54.891714 (+ 653us) server_negotiation.cc:299] Negotiation successful
0806 04:45:54.891924 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62609,"thread_start_us":62451,"threads_started":1}
I20260806 04:45:54.893432 14959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.796608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:58013 (local address 127.7.113.252:36953)
0806 04:45:54.859144 (+ 62536us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:54.859154 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:54.859181 (+ 27us) server_negotiation.cc:407] Connection header received
0806 04:45:54.871518 (+ 12337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:54.871528 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:54.871662 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:54.871942 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:54.873629 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.875195 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.878541 (+ 3346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.879804 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.879927 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.884225 (+ 4298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:54.884234 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:54.884239 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:54.884306 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:54.887970 (+ 3664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.888964 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.888970 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.888973 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.889143 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.889710 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.889717 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.889720 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.890102 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:54.890257 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:54.892798 (+ 2541us) server_negotiation.cc:299] Negotiation successful
0806 04:45:54.893031 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62361,"thread_start_us":62209,"threads_started":1}
Aug 06 04:45:54 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991554, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.253@KRBTEST.COM
I20260806 04:45:54.893905 14962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.797003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.194:34391)
0806 04:45:54.844876 (+ 47873us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:54.844904 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:54.858143 (+ 13239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:54.863153 (+ 5010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:54.863173 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:54.864559 (+ 1386us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:54.865729 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:54.865764 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.868009 (+ 2245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.868018 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:54.871121 (+ 3103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:54.871142 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.879584 (+ 8442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.879591 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:54.879909 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.880711 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:54.880753 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:54.884630 (+ 3877us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:54.888988 (+ 4358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:54.888993 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:54.888996 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:54.889476 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:54.889986 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:54.889990 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:54.889994 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:54.890421 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:54.891135 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:54.891139 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:54.891286 (+ 147us) client_negotiation.cc:769] Sending connection context
0806 04:45:54.891436 (+ 150us) client_negotiation.cc:240] Negotiation successful
0806 04:45:54.892731 (+ 1295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47692,"mutex_wait_us":977,"thread_start_us":55810,"threads_started":1}
I20260806 04:45:54.893986 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.796715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:36953 (local address 127.7.113.194:58013)
0806 04:45:54.842309 (+ 45594us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:54.842393 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:54.871305 (+ 28912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:54.872245 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:54.872253 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:54.873011 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:54.873381 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:54.873396 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.877152 (+ 3756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.877158 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:54.878384 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:54.878398 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.880198 (+ 1800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.880207 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:54.880445 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.881190 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:54.881220 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:54.883946 (+ 2726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:54.888141 (+ 4195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:54.888152 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:54.888181 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:54.888810 (+ 629us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:54.889298 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:54.889303 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:54.889306 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:54.889583 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:54.890345 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:54.890354 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:54.890804 (+ 450us) client_negotiation.cc:769] Sending connection context
0806 04:45:54.891125 (+ 321us) client_negotiation.cc:240] Negotiation successful
0806 04:45:54.891714 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45082,"thread_start_us":81811,"threads_started":1}
I20260806 04:45:54.895699 14954 heartbeater.cc:347] Connected to a master server at 127.7.113.252:36953
I20260806 04:45:54.896063 14954 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:54.896373 14955 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41047
I20260806 04:45:54.896531 14955 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:54.897143 14954 heartbeater.cc:511] Master 127.7.113.252:36953 requested a full tablet report, sending...
I20260806 04:45:54.898032 14955 heartbeater.cc:511] Master 127.7.113.254:41047 requested a full tablet report, sending...
I20260806 04:45:54.899119 13828 ts_manager.cc:194] Re-registered known tserver with Master: d549e48698944b0783d02570ba6e1e86 (127.7.113.194:43141)
I20260806 04:45:54.899312 14623 ts_manager.cc:194] Registered new tserver with Master: d549e48698944b0783d02570ba6e1e86 (127.7.113.194:43141)
I20260806 04:45:54.900341 13828 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:34391
I20260806 04:45:54.902947 14958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.796159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:38115 (local address 127.7.113.253:40771)
0806 04:45:54.877161 (+ 81002us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:54.877168 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:54.879279 (+ 2111us) server_negotiation.cc:407] Connection header received
0806 04:45:54.879449 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:54.879455 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:54.879572 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:54.879848 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:54.882045 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.884526 (+ 2481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.888019 (+ 3493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.888875 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.889031 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.896012 (+ 6981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:54.896021 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:54.896030 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:54.896072 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:54.900126 (+ 4054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.901052 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.901060 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.901064 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.901220 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:54.901701 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:54.901705 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:54.901707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:54.901984 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:54.902100 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:54.902538 (+ 438us) server_negotiation.cc:299] Negotiation successful
0806 04:45:54.902697 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80870,"thread_start_us":80743,"threads_started":1}
I20260806 04:45:54.903141 14961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:54.796716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:40771 (local address 127.7.113.194:38115)
0806 04:45:54.878983 (+ 82267us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:54.879012 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:54.879320 (+ 308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:54.880074 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:54.880079 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:54.881444 (+ 1365us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:54.881839 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:54.881852 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.884733 (+ 2881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.884742 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:54.887775 (+ 3033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:54.887805 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:54.889406 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:54.889415 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:54.889694 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:54.890835 (+ 1141us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:54.890856 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:54.895523 (+ 4667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:54.900330 (+ 4807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:54.900338 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:54.900345 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:54.900915 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:54.901374 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:54.901379 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:54.901383 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:54.901570 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:54.902129 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:54.902134 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:54.902274 (+ 140us) client_negotiation.cc:769] Sending connection context
0806 04:45:54.902435 (+ 161us) client_negotiation.cc:240] Negotiation successful
0806 04:45:54.902731 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82091,"mutex_wait_us":639,"thread_start_us":50041,"threads_started":1}
I20260806 04:45:54.904312 14956 heartbeater.cc:347] Connected to a master server at 127.7.113.253:40771
I20260806 04:45:54.904467 14956 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:54.904878 14956 heartbeater.cc:511] Master 127.7.113.253:40771 requested a full tablet report, sending...
I20260806 04:45:54.905851 14433 ts_manager.cc:194] Registered new tserver with Master: d549e48698944b0783d02570ba6e1e86 (127.7.113.194:43141)
I20260806 04:45:54.989414 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 14162
I20260806 04:45:55.007493 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:33369
--local_ip_for_outbound_sockets=127.7.113.195
--tserver_master_addrs=127.7.113.254:41047
--webserver_port=34801
--webserver_interface=127.7.113.195
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.195.keytab
--principal=oryx/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:42843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.113.254:41047,127.7.113.253:40771
--tserver_master_addrs=127.7.113.254:41047,127.7.113.253:40771,127.7.113.252:36953 with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:45:55.230247 14808 heartbeater.cc:503] Master 127.7.113.254:41047 was elected leader, sending a full tablet report...
W20260806 04:45:55.346534 14967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:45:55.346840 14967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:45:55.347018 14967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:45:55.354493 14967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:45:55.354646 14967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:45:55.354820 14967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:45:55.364593 14967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:42843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.195.keytab
--principal=oryx/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:33369
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=34801
--tserver_master_addrs=127.7.113.254:41047,127.7.113.253:40771,127.7.113.252:36953
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:45:55.365939 14967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:45:55.367305 14967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:45:55.380585 14975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:55.380755 14972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:45:55.380784 14973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:45:55.381742 14967 server_base.cc:1034] running on GCE node
I20260806 04:45:55.382397 14967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:45:55.383289 14967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:45:55.384513 14967 hybrid_clock.cc:648] HybridClock initialized: now 1785991555384469 us; error 55 us; skew 500 ppm
I20260806 04:45:55.384831 14967 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:45:55 dist-test-slave-0b58 krb5kdc[13783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991555, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:45:55.387961 14967 init.cc:377] Logged in from keytab as oryx/127.7.113.195@KRBTEST.COM (short username oryx)
I20260806 04:45:55.389405 14967 webserver.cc:460] Webserver started at http://127.7.113.195:34801/ using document root <none> and password file <none>
I20260806 04:45:55.390089 14967 fs_manager.cc:359] Metadata directory not provided
I20260806 04:45:55.390203 14967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:45:55.395509 14967 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 04:45:55.398416 14982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:55.399658 14967 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:45:55.399829 14967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "46c62df0e34242ef92aa687777c61cec"
format_stamp: "Formatted at 2026-08-06 04:45:51 on dist-test-slave-0b58"
server_key: "2dacb6d4b4f0f4ac3645647f89d1d9b2"
server_key_iv: "6c28f7aedc81c34b03cf412995dcdcf6"
server_key_version: "encryptionkey@0"
I20260806 04:45:55.400871 14967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:45:55.423122 14967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:45:55.426993 14967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:45:55.427277 14967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:45:55.428357 14967 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:45:55.429883 14967 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:45:55.430007 14967 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:55.430131 14967 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:45:55.430220 14967 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:45:55.466563 14967 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:33369
I20260806 04:45:55.466648 15095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:33369 every 8 connection(s)
I20260806 04:45:55.467978 14967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:45:55.472630 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 14967
Aug 06 04:45:55 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991555, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.253@KRBTEST.COM
Aug 06 04:45:55 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991555, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
Aug 06 04:45:55 dist-test-slave-0b58 krb5kdc[13783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991555, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.252@KRBTEST.COM
I20260806 04:45:55.497357 15101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.470782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:43845 (local address 127.7.113.253:40771)
0806 04:45:55.471289 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:55.471294 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:55.473777 (+ 2483us) server_negotiation.cc:407] Connection header received
0806 04:45:55.476217 (+ 2440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:55.476223 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:55.476336 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:55.477060 (+ 724us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:55.478970 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.480162 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.483097 (+ 2935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.483778 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.483875 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.488900 (+ 5025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:55.488908 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:55.488913 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:55.488952 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:55.492792 (+ 3840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:55.493719 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:55.493726 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:55.493732 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:55.493890 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:55.494425 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:55.494429 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:55.494432 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:55.494997 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:55.495184 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:55.496421 (+ 1237us) server_negotiation.cc:299] Negotiation successful
0806 04:45:55.496640 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":271,"threads_started":1}
I20260806 04:45:55.497633 15106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.474072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:35287 (local address 127.7.113.254:41047)
0806 04:45:55.475233 (+ 1161us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:55.475240 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:55.475259 (+ 19us) server_negotiation.cc:407] Connection header received
0806 04:45:55.476237 (+ 978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:55.476246 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:55.476407 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:55.477223 (+ 816us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:55.479729 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.480799 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.482793 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.483432 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.483551 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.489223 (+ 5672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:55.489233 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:55.489239 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:55.489280 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:55.493392 (+ 4112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:55.494279 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:55.494284 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:55.494288 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:55.494441 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:55.494943 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:55.494948 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:55.494952 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:55.495348 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:55.495560 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:55.496665 (+ 1105us) server_negotiation.cc:299] Negotiation successful
0806 04:45:55.496930 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1032,"thread_start_us":940,"threads_started":1}
I20260806 04:45:55.500677 15105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.473567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.195:35287)
0806 04:45:55.474359 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:55.474382 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:55.475849 (+ 1467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:55.476885 (+ 1036us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:55.476894 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:55.478956 (+ 2062us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:55.479557 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.479570 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.480965 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.480970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.482587 (+ 1617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.482604 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.483881 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.483889 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.484206 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.485191 (+ 985us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:55.485218 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:55.488976 (+ 3758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:55.493563 (+ 4587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:55.493567 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:55.493571 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:55.494144 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:55.494611 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:55.494616 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:55.494619 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:55.494805 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:55.495634 (+ 829us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:55.495638 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:55.495865 (+ 227us) client_negotiation.cc:769] Sending connection context
0806 04:45:55.496245 (+ 380us) client_negotiation.cc:240] Negotiation successful
0806 04:45:55.498755 (+ 2510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"mutex_wait_us":303,"spinlock_wait_cycles":78592,"thread_start_us":1139,"threads_started":1}
I20260806 04:45:55.500790 15102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.471203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:40771 (local address 127.7.113.195:43845)
0806 04:45:55.473140 (+ 1937us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:55.473159 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:55.475823 (+ 2664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:55.476882 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:55.476893 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:55.477805 (+ 912us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:55.478802 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.478820 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.480384 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.480389 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.482947 (+ 2558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.482959 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.484177 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.484184 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.484387 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.485097 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:55.485144 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:55.488639 (+ 3495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:55.492961 (+ 4322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:55.492972 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:55.492994 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:55.493576 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:55.494044 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:55.494049 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:55.494053 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:55.494295 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:55.495330 (+ 1035us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:55.495338 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:55.495881 (+ 543us) client_negotiation.cc:769] Sending connection context
0806 04:45:55.497948 (+ 2067us) client_negotiation.cc:240] Negotiation successful
0806 04:45:55.498628 (+ 680us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"mutex_wait_us":508,"thread_start_us":704,"threads_started":1}
I20260806 04:45:55.502101 15103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.471810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:36953 (local address 127.7.113.195:56887)
0806 04:45:55.472434 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:55.472476 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:55.475823 (+ 3347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:55.476882 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:55.476893 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:55.478412 (+ 1519us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:45:55.479555 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.479572 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.482101 (+ 2529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.482109 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.484522 (+ 2413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.484542 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.486259 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.486268 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.486595 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.487741 (+ 1146us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:45:55.487778 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:45:55.491020 (+ 3242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:45:55.497138 (+ 6118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:55.497145 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:55.497152 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:55.498763 (+ 1611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:55.499349 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:45:55.499357 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:45:55.499360 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:45:55.499677 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:45:55.500678 (+ 1001us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:45:55.500686 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:45:55.501137 (+ 451us) client_negotiation.cc:769] Sending connection context
0806 04:45:55.501340 (+ 203us) client_negotiation.cc:240] Negotiation successful
0806 04:45:55.501654 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"mutex_wait_us":67,"thread_start_us":1013,"threads_started":1}
I20260806 04:45:55.502699 15097 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41047
I20260806 04:45:55.503019 15097 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:55.503159 15104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.471893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:56887 (local address 127.7.113.252:36953)
0806 04:45:55.473873 (+ 1980us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:55.473879 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:55.473901 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:45:55.476217 (+ 2316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:55.476223 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:55.476336 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:55.476594 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:55.479789 (+ 3195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.481380 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.484735 (+ 3355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.485659 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.485784 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.491269 (+ 5485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:55.491275 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:55.491279 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:55.491333 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:55.496919 (+ 5586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:55.498931 (+ 2012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:55.498939 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:55.498945 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:55.499179 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:55.499834 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:55.499842 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:55.499847 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:55.500415 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:55.500590 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:55.502456 (+ 1866us) server_negotiation.cc:299] Negotiation successful
0806 04:45:55.502683 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1865,"thread_start_us":1745,"threads_started":1}
I20260806 04:45:55.503979 15097 heartbeater.cc:511] Master 127.7.113.254:41047 requested a full tablet report, sending...
I20260806 04:45:55.504907 15098 heartbeater.cc:347] Connected to a master server at 127.7.113.253:40771
I20260806 04:45:55.505038 15098 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:55.505577 15098 heartbeater.cc:511] Master 127.7.113.253:40771 requested a full tablet report, sending...
I20260806 04:45:55.505923 13828 ts_manager.cc:194] Re-registered known tserver with Master: 46c62df0e34242ef92aa687777c61cec (127.7.113.195:33369)
I20260806 04:45:55.506078 15096 heartbeater.cc:347] Connected to a master server at 127.7.113.252:36953
I20260806 04:45:55.506230 15096 heartbeater.cc:464] Registering TS with master...
I20260806 04:45:55.506608 15096 heartbeater.cc:511] Master 127.7.113.252:36953 requested a full tablet report, sending...
I20260806 04:45:55.506862 14433 ts_manager.cc:194] Registered new tserver with Master: 46c62df0e34242ef92aa687777c61cec (127.7.113.195:33369)
I20260806 04:45:55.507061 13828 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:35287
I20260806 04:45:55.508582 14623 ts_manager.cc:194] Registered new tserver with Master: 46c62df0e34242ef92aa687777c61cec (127.7.113.195:33369)
I20260806 04:45:55.527443 15106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.509152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41728 (local address 127.7.113.254:41047)
0806 04:45:55.509951 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:55.509958 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:55.510901 (+ 943us) server_negotiation.cc:407] Connection header received
0806 04:45:55.511164 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:55.511170 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:55.511250 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:55.511315 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:55.513523 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.514353 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.516247 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.516899 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.517052 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.521214 (+ 4162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:55.521221 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:55.521226 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:55.521266 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:55.524120 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:55.525006 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:55.525012 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:55.525016 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:55.525177 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:55.525604 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:55.525609 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:55.525611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:55.525972 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:55.526243 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:55.526848 (+ 605us) server_negotiation.cc:299] Negotiation successful
0806 04:45:55.527100 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":664}
I20260806 04:45:55.528167 15101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.491448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59972 (local address 127.7.113.253:40771)
0806 04:45:55.497906 (+ 6458us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:55.497914 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:55.510468 (+ 12554us) server_negotiation.cc:407] Connection header received
0806 04:45:55.510853 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:55.510861 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:55.510974 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:55.511068 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:55.514025 (+ 2957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.515146 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.517134 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.517873 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.517968 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.521176 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:55.521185 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:55.521189 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:55.521229 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:55.524739 (+ 3510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:55.525524 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:55.525531 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:55.525535 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:55.525674 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:55.526091 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:55.526096 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:55.526099 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:55.526467 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:55.526713 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:55.527500 (+ 787us) server_negotiation.cc:299] Negotiation successful
0806 04:45:55.527790 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6346,"thread_start_us":18064,"threads_started":1}
I20260806 04:45:55.528213 15104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.509328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58808 (local address 127.7.113.252:36953)
0806 04:45:55.510664 (+ 1336us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:55.510671 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:55.511319 (+ 648us) server_negotiation.cc:407] Connection header received
0806 04:45:55.511562 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:55.511568 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:55.511659 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:55.511727 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:55.514387 (+ 2660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.515115 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.516776 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.517406 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.517530 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.521276 (+ 3746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:55.521291 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:55.521298 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:55.521335 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:55.524894 (+ 3559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:55.525808 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:55.525813 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:55.525816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:55.525944 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:55.526329 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:55.526334 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:55.526337 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:55.526585 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:55.526845 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:55.527415 (+ 570us) server_negotiation.cc:299] Negotiation successful
0806 04:45:55.527897 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1228}
I20260806 04:45:55.531644 13828 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:45:55.538812 13828 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:45:55.598528 15127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.574746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:43141 (local address 127.0.0.1:56962)
0806 04:45:55.586224 (+ 11478us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:55.586238 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:55.586492 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:55.587681 (+ 1189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:55.587689 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:55.587724 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:55.588184 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.588199 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.591359 (+ 3160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.591368 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.594459 (+ 3091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.594480 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.597280 (+ 2800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.597289 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.597562 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.597618 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 04:45:55.597732 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 04:45:55.597923 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11343,"mutex_wait_us":1,"thread_start_us":7653,"threads_started":1}
I20260806 04:45:55.599285 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.574273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:33369 (local address 127.0.0.1:43268)
0806 04:45:55.582686 (+ 8413us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:55.582702 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:55.582934 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:55.585668 (+ 2734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:55.585677 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:55.585716 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:55.586267 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.586283 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.588949 (+ 2666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.588958 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.593438 (+ 4480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.593459 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.597760 (+ 4301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.597769 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.598055 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.598111 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 04:45:55.598210 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 04:45:55.598444 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8270,"mutex_wait_us":1,"thread_start_us":11674,"threads_started":1}
I20260806 04:45:55.600031 15128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.574623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43268 (local address 127.7.113.195:33369)
0806 04:45:55.584914 (+ 10291us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:55.584923 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:55.584957 (+ 34us) server_negotiation.cc:407] Connection header received
0806 04:45:55.585060 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:55.585070 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:55.585387 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:55.585635 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:55.586507 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.588724 (+ 2217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.593668 (+ 4944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.597147 (+ 3479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.597357 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.599028 (+ 1671us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:55.599124 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 04:45:55.599352 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10110,"thread_start_us":9936,"threads_started":1}
I20260806 04:45:55.600687 15130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.575167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56962 (local address 127.7.113.194:43141)
0806 04:45:55.576158 (+ 991us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:55.576167 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:55.586652 (+ 10485us) server_negotiation.cc:407] Connection header received
0806 04:45:55.586770 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:55.586778 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:55.587042 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:55.587414 (+ 372us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:55.588472 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.591114 (+ 2642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.594702 (+ 3588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.596681 (+ 1979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.596842 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.597133 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:55.599992 (+ 2859us) server_negotiation.cc:299] Negotiation successful
0806 04:45:55.600243 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":806,"thread_start_us":702,"threads_started":1}
I20260806 04:45:55.604600 14887 tablet_service.cc:1467] Processing CreateTablet for tablet 65df2d200b264547a08b72a53288993c (DEFAULT_TABLE table=test-table [id=9612d9eca0da4d54a764c31076b4911a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:55.604628 15031 tablet_service.cc:1467] Processing CreateTablet for tablet 65df2d200b264547a08b72a53288993c (DEFAULT_TABLE table=test-table [id=9612d9eca0da4d54a764c31076b4911a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:55.605967 15031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65df2d200b264547a08b72a53288993c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:55.605978 14887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65df2d200b264547a08b72a53288993c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:55.608688 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.586379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:35253 (local address 127.0.0.1:44426)
0806 04:45:55.599561 (+ 13182us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:55.599583 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:55.599704 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:55.601958 (+ 2254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:55.601965 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:55.601993 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:55.602160 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.602170 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.603939 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.603945 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.605816 (+ 1871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.605832 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.607900 (+ 2068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.607906 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.608090 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.608123 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 04:45:55.608227 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 04:45:55.608397 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13050,"thread_start_us":14286,"threads_started":1}
I20260806 04:45:55.609041 15132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.586695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44426 (local address 127.7.113.193:35253)
0806 04:45:55.601330 (+ 14635us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:55.601338 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:55.601361 (+ 23us) server_negotiation.cc:407] Connection header received
0806 04:45:55.601436 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:55.601441 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:55.601608 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:55.601990 (+ 382us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:55.602314 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.603782 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.605984 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.607436 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.607572 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.607797 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:55.608323 (+ 526us) server_negotiation.cc:299] Negotiation successful
0806 04:45:55.608556 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14462,"thread_start_us":14349,"threads_started":1}
I20260806 04:45:55.612934 14740 tablet_service.cc:1467] Processing CreateTablet for tablet 65df2d200b264547a08b72a53288993c (DEFAULT_TABLE table=test-table [id=9612d9eca0da4d54a764c31076b4911a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:55.614300 14740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65df2d200b264547a08b72a53288993c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:55.619084 15133 tablet_bootstrap.cc:492] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec: Bootstrap starting.
I20260806 04:45:55.621951 15134 tablet_bootstrap.cc:492] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86: Bootstrap starting.
I20260806 04:45:55.623795 15133 tablet_bootstrap.cc:654] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:55.624950 15133 log.cc:824] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:55.625322 15134 tablet_bootstrap.cc:654] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:55.626549 15134 log.cc:824] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:55.627923 15133 tablet_bootstrap.cc:492] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec: No bootstrap required, opened a new log
I20260806 04:45:55.628194 15133 ts_tablet_manager.cc:1397] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 04:45:55.629834 15134 tablet_bootstrap.cc:492] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86: No bootstrap required, opened a new log
I20260806 04:45:55.630185 15134 ts_tablet_manager.cc:1397] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.006s
I20260806 04:45:55.632977 15137 tablet_bootstrap.cc:492] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56: Bootstrap starting.
I20260806 04:45:55.636499 15137 tablet_bootstrap.cc:654] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:55.637799 15137 log.cc:824] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56: Log is configured to *not* fsync() on all Append() calls
I20260806 04:45:55.639019 15134 raft_consensus.cc:348] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:55.639451 15134 raft_consensus.cc:374] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:55.639202 15133 raft_consensus.cc:348] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:55.639585 15134 raft_consensus.cc:729] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d549e48698944b0783d02570ba6e1e86, State: Initialized, Role: FOLLOWER
I20260806 04:45:55.639614 15133 raft_consensus.cc:374] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:55.639715 15133 raft_consensus.cc:729] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46c62df0e34242ef92aa687777c61cec, State: Initialized, Role: FOLLOWER
I20260806 04:45:55.640442 15134 consensus_queue.cc:260] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:55.640497 15133 consensus_queue.cc:260] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:55.641086 15137 tablet_bootstrap.cc:492] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56: No bootstrap required, opened a new log
I20260806 04:45:55.641403 15137 ts_tablet_manager.cc:1397] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260806 04:45:55.642586 15133 ts_tablet_manager.cc:1428] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec: Time spent starting tablet: real 0.014s user 0.008s sys 0.003s
I20260806 04:45:55.643450 15097 heartbeater.cc:503] Master 127.7.113.254:41047 was elected leader, sending a full tablet report...
I20260806 04:45:55.648770 15134 ts_tablet_manager.cc:1428] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86: Time spent starting tablet: real 0.018s user 0.007s sys 0.011s
I20260806 04:45:55.649128 14955 heartbeater.cc:503] Master 127.7.113.254:41047 was elected leader, sending a full tablet report...
I20260806 04:45:55.652523 15137 raft_consensus.cc:348] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:55.652998 15137 raft_consensus.cc:374] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:55.653108 15137 raft_consensus.cc:729] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbca05291a74430a535417c808f5b56, State: Initialized, Role: FOLLOWER
I20260806 04:45:55.654598 15137 consensus_queue.cc:260] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:55.656283 15137 ts_tablet_manager.cc:1428] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56: Time spent starting tablet: real 0.015s user 0.012s sys 0.002s
W20260806 04:45:55.700555 14810 tablet.cc:2369] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:45:55.720868 15099 tablet.cc:2369] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:45:55.796554 14957 tablet.cc:2369] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:45:55.976171 15139 raft_consensus.cc:482] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:55.976548 15139 raft_consensus.cc:504] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:55.978250 15139 leader_election.cc:288] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46c62df0e34242ef92aa687777c61cec (127.7.113.195:33369), bdbca05291a74430a535417c808f5b56 (127.7.113.193:35253)
I20260806 04:45:55.980005 15141 raft_consensus.cc:482] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:55.980334 15141 raft_consensus.cc:504] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:55.982224 15141 leader_election.cc:288] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46c62df0e34242ef92aa687777c61cec (127.7.113.195:33369), d549e48698944b0783d02570ba6e1e86 (127.7.113.194:43141)
I20260806 04:45:55.983621 15140 raft_consensus.cc:482] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:55.984045 15140 raft_consensus.cc:504] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:55.985899 15140 leader_election.cc:288] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d549e48698944b0783d02570ba6e1e86 (127.7.113.194:43141), bdbca05291a74430a535417c808f5b56 (127.7.113.193:35253)
I20260806 04:45:55.989289 15132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.979489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:60749 (local address 127.7.113.193:35253)
0806 04:45:55.979847 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:55.979854 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:55.981044 (+ 1190us) server_negotiation.cc:407] Connection header received
0806 04:45:55.981285 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:55.981291 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:55.981371 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:55.981426 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:55.982114 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.983296 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.986895 (+ 3599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.988157 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.988304 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.988383 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:55.988921 (+ 538us) server_negotiation.cc:299] Negotiation successful
0806 04:45:55.989051 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193}
I20260806 04:45:55.993191 15143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.979355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:35253 (local address 127.7.113.194:60749)
0806 04:45:55.980846 (+ 1491us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:55.980866 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:55.981140 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:55.981591 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:55.981596 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:55.981618 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:55.981929 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.981941 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.983557 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.983563 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.986723 (+ 3160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.986738 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.988558 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.988572 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.988744 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.988777 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 04:45:55.992495 (+ 3718us) client_negotiation.cc:240] Negotiation successful
0806 04:45:55.992697 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":301,"threads_started":1}
I20260806 04:45:55.999676 15103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.986182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:35253 (local address 127.7.113.195:50341)
0806 04:45:55.986378 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:55.986396 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:55.986497 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:55.989963 (+ 3466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:55.989968 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:55.990001 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:55.990171 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.990181 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.992007 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.992013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.996190 (+ 4177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.996208 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.998678 (+ 2470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.998687 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.998974 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.999027 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 04:45:55.999127 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 04:45:55.999304 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":1678}
I20260806 04:45:56.000555 15132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.986574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:50341 (local address 127.7.113.193:35253)
0806 04:45:55.989508 (+ 2934us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:55.989514 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:55.989535 (+ 21us) server_negotiation.cc:407] Connection header received
0806 04:45:55.989594 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:55.989599 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:55.989661 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:55.989737 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:55.990775 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.991851 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.996416 (+ 4565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.998210 (+ 1794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.998358 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.998462 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:55.999993 (+ 1531us) server_negotiation.cc:299] Negotiation successful
0806 04:45:56.000171 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2825,"threads_started":1}
I20260806 04:45:56.002303 14761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65df2d200b264547a08b72a53288993c" candidate_uuid: "46c62df0e34242ef92aa687777c61cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbca05291a74430a535417c808f5b56" is_pre_election: true
I20260806 04:45:56.002880 14761 raft_consensus.cc:2454] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46c62df0e34242ef92aa687777c61cec in term 0.
I20260806 04:45:56.003904 14761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65df2d200b264547a08b72a53288993c" candidate_uuid: "d549e48698944b0783d02570ba6e1e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbca05291a74430a535417c808f5b56" is_pre_election: true
I20260806 04:45:56.004124 14761 raft_consensus.cc:2454] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d549e48698944b0783d02570ba6e1e86 in term 0.
I20260806 04:45:56.004331 15128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.978685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:56965 (local address 127.7.113.195:33369)
0806 04:45:55.978866 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:55.978870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:55.979480 (+ 610us) server_negotiation.cc:407] Connection header received
0806 04:45:55.979773 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:55.979790 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:55.979887 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:55.979964 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:55.980832 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.981898 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.992116 (+ 10218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.993833 (+ 1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.993991 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:55.994107 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:56.003893 (+ 9786us) server_negotiation.cc:299] Negotiation successful
0806 04:45:56.004055 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 04:45:56.004685 14984 leader_election.cc:302] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46c62df0e34242ef92aa687777c61cec, bdbca05291a74430a535417c808f5b56; no voters:
I20260806 04:45:56.005113 15142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.978509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:33369 (local address 127.7.113.194:56965)
0806 04:45:55.979219 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:55.979244 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:55.979548 (+ 304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:55.980198 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:55.980203 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:55.980231 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:55.980639 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.980653 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:55.982091 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:55.982096 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:55.991805 (+ 9709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:55.991824 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.001792 (+ 9968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.001798 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:56.001991 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:56.002026 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 04:45:56.004568 (+ 2542us) client_negotiation.cc:240] Negotiation successful
0806 04:45:56.004734 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":353,"threads_started":1}
I20260806 04:45:56.005111 15140 raft_consensus.cc:2781] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:45:56.005268 15140 raft_consensus.cc:482] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:45:56.005383 15140 raft_consensus.cc:3037] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:56.005937 15051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65df2d200b264547a08b72a53288993c" candidate_uuid: "d549e48698944b0783d02570ba6e1e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46c62df0e34242ef92aa687777c61cec" is_pre_election: true
I20260806 04:45:56.008917 15140 raft_consensus.cc:504] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:56.009341 14840 leader_election.cc:302] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdbca05291a74430a535417c808f5b56, d549e48698944b0783d02570ba6e1e86; no voters:
I20260806 04:45:56.009593 15051 raft_consensus.cc:2379] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d549e48698944b0783d02570ba6e1e86 in current term 1: Already voted for candidate 46c62df0e34242ef92aa687777c61cec in this term.
I20260806 04:45:56.009876 15139 raft_consensus.cc:2781] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:45:56.010028 15139 raft_consensus.cc:482] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:45:56.010167 15139 raft_consensus.cc:3037] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:56.010188 15140 leader_election.cc:288] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [CANDIDATE]: Term 1 election: Requested vote from peers d549e48698944b0783d02570ba6e1e86 (127.7.113.194:43141), bdbca05291a74430a535417c808f5b56 (127.7.113.193:35253)
I20260806 04:45:56.010737 14761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65df2d200b264547a08b72a53288993c" candidate_uuid: "46c62df0e34242ef92aa687777c61cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbca05291a74430a535417c808f5b56"
I20260806 04:45:56.010927 14761 raft_consensus.cc:3037] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:56.013535 15139 raft_consensus.cc:504] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:56.014125 14761 raft_consensus.cc:2454] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46c62df0e34242ef92aa687777c61cec in term 1.
I20260806 04:45:56.014585 15139 leader_election.cc:288] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [CANDIDATE]: Term 1 election: Requested vote from peers 46c62df0e34242ef92aa687777c61cec (127.7.113.195:33369), bdbca05291a74430a535417c808f5b56 (127.7.113.193:35253)
I20260806 04:45:56.014869 15130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.983394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:43815 (local address 127.7.113.194:43141)
0806 04:45:55.986201 (+ 2807us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:55.986212 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:56.003167 (+ 16955us) server_negotiation.cc:407] Connection header received
0806 04:45:56.003503 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:56.003508 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:56.003568 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:56.003620 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:56.004708 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.005698 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.011892 (+ 6194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.013243 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.013388 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:56.013453 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:56.014389 (+ 936us) server_negotiation.cc:299] Negotiation successful
0806 04:45:56.014533 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":2666}
I20260806 04:45:56.015514 15105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.986529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:43141 (local address 127.7.113.195:37423)
0806 04:45:55.986691 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:55.986712 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:55.986837 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:56.002175 (+ 15338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:56.002180 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:56.002212 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:56.002433 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:56.002443 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.007104 (+ 4661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.007110 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:56.009213 (+ 2103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:56.009228 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.014735 (+ 5507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.014741 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:56.014985 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:56.015027 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 04:45:56.015102 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 04:45:56.015252 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":1}
I20260806 04:45:56.015529 15051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65df2d200b264547a08b72a53288993c" candidate_uuid: "d549e48698944b0783d02570ba6e1e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46c62df0e34242ef92aa687777c61cec"
I20260806 04:45:56.015843 15051 raft_consensus.cc:2379] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d549e48698944b0783d02570ba6e1e86 in current term 1: Already voted for candidate 46c62df0e34242ef92aa687777c61cec in this term.
I20260806 04:45:56.015818 15146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.983769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:44791 (local address 127.7.113.195:33369)
0806 04:45:55.994214 (+ 10445us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:55.994224 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:56.002029 (+ 7805us) server_negotiation.cc:407] Connection header received
0806 04:45:56.002322 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:56.002335 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:56.002415 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:56.002653 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:56.003652 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.004822 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.007419 (+ 2597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.011385 (+ 3966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.011558 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:56.011623 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:56.015273 (+ 3650us) server_negotiation.cc:299] Negotiation successful
0806 04:45:56.015408 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2260,"server-negotiator.queue_time_us":10285,"thread_start_us":16992,"threads_started":1}
I20260806 04:45:56.016054 15145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.982857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:43141 (local address 127.7.113.193:43815)
0806 04:45:56.002912 (+ 20055us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:56.002942 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:56.003343 (+ 401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:56.003782 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:56.003786 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:56.003811 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:56.004382 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:56.004546 (+ 164us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.006211 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.006216 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:56.010578 (+ 4362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:56.010593 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.013936 (+ 3343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.013943 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:56.014140 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:56.014178 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 04:45:56.014630 (+ 452us) client_negotiation.cc:240] Negotiation successful
0806 04:45:56.015360 (+ 730us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17544,"thread_start_us":25941,"threads_started":1}
I20260806 04:45:56.016543 15148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.986893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:37423 (local address 127.7.113.194:43141)
0806 04:45:56.001302 (+ 14409us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:56.001307 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:56.001330 (+ 23us) server_negotiation.cc:407] Connection header received
0806 04:45:56.001385 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:56.001390 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:56.001453 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:56.002571 (+ 1118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:56.002828 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.006941 (+ 4113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.011762 (+ 4821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.014553 (+ 2791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.015810 (+ 1257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:56.015905 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:56.015966 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 04:45:56.016154 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14301,"thread_start_us":14098,"threads_started":1}
I20260806 04:45:56.016760 15144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:55.983691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:33369 (local address 127.7.113.193:44791)
0806 04:45:56.001795 (+ 18104us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:56.001815 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:56.002134 (+ 319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:56.002961 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:56.002968 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:56.002995 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:56.003406 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:56.003424 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.005047 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.005052 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:56.007235 (+ 2183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:56.007251 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.014876 (+ 7625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.014883 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:56.015087 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:56.015118 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 04:45:56.015590 (+ 472us) client_negotiation.cc:240] Negotiation successful
0806 04:45:56.016227 (+ 637us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17973,"thread_start_us":16450,"threads_started":1}
I20260806 04:45:56.017405 15051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65df2d200b264547a08b72a53288993c" candidate_uuid: "bdbca05291a74430a535417c808f5b56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46c62df0e34242ef92aa687777c61cec" is_pre_election: true
I20260806 04:45:56.017367 14907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65df2d200b264547a08b72a53288993c" candidate_uuid: "46c62df0e34242ef92aa687777c61cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d549e48698944b0783d02570ba6e1e86" is_pre_election: true
I20260806 04:45:56.017634 15051 raft_consensus.cc:2379] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdbca05291a74430a535417c808f5b56 in current term 1: Already voted for candidate 46c62df0e34242ef92aa687777c61cec in this term.
I20260806 04:45:56.017661 14905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65df2d200b264547a08b72a53288993c" candidate_uuid: "46c62df0e34242ef92aa687777c61cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d549e48698944b0783d02570ba6e1e86"
I20260806 04:45:56.017932 14907 raft_consensus.cc:2379] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46c62df0e34242ef92aa687777c61cec in current term 1: Already voted for candidate d549e48698944b0783d02570ba6e1e86 in this term.
I20260806 04:45:56.018384 14906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65df2d200b264547a08b72a53288993c" candidate_uuid: "bdbca05291a74430a535417c808f5b56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d549e48698944b0783d02570ba6e1e86" is_pre_election: true
I20260806 04:45:56.018662 14984 leader_election.cc:302] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46c62df0e34242ef92aa687777c61cec, bdbca05291a74430a535417c808f5b56; no voters:
I20260806 04:45:56.018745 14906 raft_consensus.cc:2379] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdbca05291a74430a535417c808f5b56 in current term 1: Already voted for candidate d549e48698944b0783d02570ba6e1e86 in this term.
I20260806 04:45:56.019124 15140 raft_consensus.cc:2781] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:56.019220 14692 leader_election.cc:302] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbca05291a74430a535417c808f5b56; no voters: 46c62df0e34242ef92aa687777c61cec, d549e48698944b0783d02570ba6e1e86
I20260806 04:45:56.019613 14761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65df2d200b264547a08b72a53288993c" candidate_uuid: "d549e48698944b0783d02570ba6e1e86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbca05291a74430a535417c808f5b56"
I20260806 04:45:56.019691 15141 raft_consensus.cc:2726] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 04:45:56.019999 14761 raft_consensus.cc:2379] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d549e48698944b0783d02570ba6e1e86 in current term 1: Already voted for candidate 46c62df0e34242ef92aa687777c61cec in this term.
I20260806 04:45:56.020184 15140 raft_consensus.cc:686] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 1 LEADER]: Becoming Leader. State: Replica: 46c62df0e34242ef92aa687777c61cec, State: Running, Role: LEADER
I20260806 04:45:56.020761 14840 leader_election.cc:302] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d549e48698944b0783d02570ba6e1e86; no voters: 46c62df0e34242ef92aa687777c61cec, bdbca05291a74430a535417c808f5b56
I20260806 04:45:56.021056 15139 raft_consensus.cc:2726] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260806 04:45:56.020972 15140 consensus_queue.cc:237] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:56.025655 13827 catalog_manager.cc:5495] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 46c62df0e34242ef92aa687777c61cec (127.7.113.195). New cstate: current_term: 1 leader_uuid: "46c62df0e34242ef92aa687777c61cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260806 04:45:56.147408 15146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:56.141870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43280 (local address 127.7.113.195:33369)
0806 04:45:56.142045 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:56.142049 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:56.142343 (+ 294us) server_negotiation.cc:407] Connection header received
0806 04:45:56.142521 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:56.142525 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:56.142617 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:56.142739 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:56.143104 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.143842 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.145262 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.145700 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.145845 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:56.146350 (+ 505us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:56.146827 (+ 477us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:56.146987 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:56.147048 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 04:45:56.147125 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 04:45:56.155146 14906 raft_consensus.cc:1261] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 1 FOLLOWER]: Refusing update from remote peer 46c62df0e34242ef92aa687777c61cec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:56.155128 14761 raft_consensus.cc:1261] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [term 1 FOLLOWER]: Refusing update from remote peer 46c62df0e34242ef92aa687777c61cec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:56.155923 15149 consensus_queue.cc:1035] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:56.156234 15140 consensus_queue.cc:1035] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:56.173959 15155 mvcc.cc:205] Tried to move back new op lower bound from 7315421414001291264 to 7315421413465391104. Current Snapshot: MvccSnapshot[applied={T|T < 7315421414001291264}]
I20260806 04:45:56.177196 15153 mvcc.cc:205] Tried to move back new op lower bound from 7315421414001291264 to 7315421413465391104. Current Snapshot: MvccSnapshot[applied={T|T < 7315421414001291264 or (T in {7315421414001291264})}]
I20260806 04:45:56.189536 13827 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:56.189844 13827 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:56.197993 13827 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2abfd07f6b904abe93be3f40932d6c70: Sending DeleteTablet for 3 replicas of tablet 65df2d200b264547a08b72a53288993c
I20260806 04:45:56.199540 14887 tablet_service.cc:1514] Processing DeleteTablet for tablet 65df2d200b264547a08b72a53288993c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:56 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:56962
I20260806 04:45:56.199654 14740 tablet_service.cc:1514] Processing DeleteTablet for tablet 65df2d200b264547a08b72a53288993c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:56 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:44426
I20260806 04:45:56.201344 15031 tablet_service.cc:1514] Processing DeleteTablet for tablet 65df2d200b264547a08b72a53288993c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:56 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:43268
I20260806 04:45:56.209591 15167 tablet_replica.cc:330] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec: stopping tablet replica
I20260806 04:45:56.212064 15167 raft_consensus.cc:2229] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:45:56.212952 15167 raft_consensus.cc:2258] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:56.213624 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 13796
I20260806 04:45:56.214820 13859 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:56.218225 15167 ts_tablet_manager.cc:1905] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:56.246623 15167 ts_tablet_manager.cc:1918] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:45:56.246870 15167 log.cc:1196] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/65df2d200b264547a08b72a53288993c
I20260806 04:45:56.247525 15167 ts_tablet_manager.cc:1939] T 65df2d200b264547a08b72a53288993c P 46c62df0e34242ef92aa687777c61cec: Deleting consensus metadata
I20260806 04:45:56.252125 15164 tablet_replica.cc:330] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56: stopping tablet replica
I20260806 04:45:56.252767 15164 raft_consensus.cc:2229] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:56.253417 15164 raft_consensus.cc:2258] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:56.255645 15164 ts_tablet_manager.cc:1905] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:56.259459 15163 tablet_replica.cc:330] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86: stopping tablet replica
I20260806 04:45:56.259886 15163 raft_consensus.cc:2229] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:56.260419 15163 raft_consensus.cc:2258] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:56.262260 15163 ts_tablet_manager.cc:1905] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:56.264145 15164 ts_tablet_manager.cc:1918] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:45:56.264622 15164 log.cc:1196] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/65df2d200b264547a08b72a53288993c
I20260806 04:45:56.265262 15164 ts_tablet_manager.cc:1939] T 65df2d200b264547a08b72a53288993c P bdbca05291a74430a535417c808f5b56: Deleting consensus metadata
I20260806 04:45:56.269703 15166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:56.201013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59988 (local address 127.7.113.253:40771)
0806 04:45:56.231045 (+ 30032us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:56.231054 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:56.231078 (+ 24us) server_negotiation.cc:407] Connection header received
0806 04:45:56.231150 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:56.231156 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:56.232049 (+ 893us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:56.235090 (+ 3041us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:56.235315 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.236636 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.248866 (+ 12230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.249596 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.254060 (+ 4464us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:56.254354 (+ 294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:56.254361 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:56.254365 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:56.254402 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:56.258318 (+ 3916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:56.265983 (+ 7665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:56.265991 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:56.265996 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:56.266179 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:56.266824 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:56.266829 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:56.266833 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:56.267202 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:56.268899 (+ 1697us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:56.269021 (+ 122us) server_negotiation.cc:299] Negotiation successful
0806 04:45:56.269269 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29858,"thread_start_us":29612,"threads_started":1}
I20260806 04:45:56.272162 15163 ts_tablet_manager.cc:1918] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:45:56.272403 15163 log.cc:1196] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/65df2d200b264547a08b72a53288993c
I20260806 04:45:56.272998 15163 ts_tablet_manager.cc:1939] T 65df2d200b264547a08b72a53288993c P d549e48698944b0783d02570ba6e1e86: Deleting consensus metadata
I20260806 04:45:56.283358 15168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:56.210778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58820 (local address 127.7.113.252:36953)
0806 04:45:56.249168 (+ 38390us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:56.249175 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:56.268560 (+ 19385us) server_negotiation.cc:407] Connection header received
0806 04:45:56.268717 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:56.268723 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:56.268812 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:56.268914 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:56.270779 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.272016 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.273993 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.274632 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.274746 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:56.277679 (+ 2933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:56.277685 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:56.277689 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:56.277723 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:56.280542 (+ 2819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:56.281228 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:56.281232 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:56.281234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:56.281371 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:56.281782 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:56.281786 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:56.281788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:56.282046 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:56.282313 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:56.282607 (+ 294us) server_negotiation.cc:299] Negotiation successful
0806 04:45:56.282919 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38254,"thread_start_us":38399,"threads_started":1}
I20260806 04:45:56.408617 13812 catalog_manager.cc:4841] TS bdbca05291a74430a535417c808f5b56 (127.7.113.193:35253): tablet 65df2d200b264547a08b72a53288993c (table test-table [id=9612d9eca0da4d54a764c31076b4911a]) successfully deleted
I20260806 04:45:56.408900 13813 catalog_manager.cc:4841] TS d549e48698944b0783d02570ba6e1e86 (127.7.113.194:43141): tablet 65df2d200b264547a08b72a53288993c (table test-table [id=9612d9eca0da4d54a764c31076b4911a]) successfully deleted
I20260806 04:45:56.409018 13812 catalog_manager.cc:4841] TS 46c62df0e34242ef92aa687777c61cec (127.7.113.195:33369): tablet 65df2d200b264547a08b72a53288993c (table test-table [id=9612d9eca0da4d54a764c31076b4911a]) successfully deleted
I20260806 04:45:56.409636 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 13796
W20260806 04:45:56.435133 14808 heartbeater.cc:644] Failed to heartbeat to 127.7.113.254:41047 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.7.113.254:41047 (error 108)
I20260806 04:45:56.468456 15168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:56.439327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58834 (local address 127.7.113.252:36953)
0806 04:45:56.443788 (+ 4461us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:56.443794 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:56.451113 (+ 7319us) server_negotiation.cc:407] Connection header received
0806 04:45:56.451470 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:56.451476 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:56.451562 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:56.451637 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:56.454606 (+ 2969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.455449 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.457289 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.458003 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.458134 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:56.461772 (+ 3638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:56.461779 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:56.461784 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:56.461831 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:56.465364 (+ 3533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:56.466246 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:56.466253 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:56.466258 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:56.466412 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:56.466859 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:56.466867 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:56.466873 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:56.467211 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:56.467430 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:56.467830 (+ 400us) server_negotiation.cc:299] Negotiation successful
0806 04:45:56.468067 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4291}
I20260806 04:45:56.470381 15166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:56.438544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59998 (local address 127.7.113.253:40771)
0806 04:45:56.438753 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:56.438760 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:56.450536 (+ 11776us) server_negotiation.cc:407] Connection header received
0806 04:45:56.451865 (+ 1329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:56.451870 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:56.451955 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:56.452074 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:56.454593 (+ 2519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.455746 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.457538 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:56.457948 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:56.458089 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:56.460973 (+ 2884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:56.460978 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:56.460981 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:56.461013 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:56.463867 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:56.464551 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:56.464563 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:56.464566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:56.464693 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:56.465069 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:56.465073 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:56.465075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:56.465324 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:56.469647 (+ 4323us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:56.469806 (+ 159us) server_negotiation.cc:299] Negotiation successful
0806 04:45:56.470054 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 04:45:57.179185 15177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.178232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.194:51579)
0806 04:45:57.178898 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.179029 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":390,"threads_started":1}
W20260806 04:45:57.179564 14955 heartbeater.cc:644] Failed to heartbeat to 127.7.113.254:41047 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
I20260806 04:45:57.192979 15178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.192208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.195:57477)
0806 04:45:57.192650 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.192794 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":259,"threads_started":1}
W20260806 04:45:57.193399 15097 heartbeater.cc:644] Failed to heartbeat to 127.7.113.254:41047 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
I20260806 04:45:57.436652 15179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.435860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.193:48237)
0806 04:45:57.436358 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.436482 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":217,"threads_started":1}
I20260806 04:45:57.698658 15180 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2abfd07f6b904abe93be3f40932d6c70)
I20260806 04:45:57.698988 15180 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } }
I20260806 04:45:57.700412 15180 leader_election.cc:288] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2abfd07f6b904abe93be3f40932d6c70 (127.7.113.254:41047), ae6926d5ce374b189a76c42492abe2f7 (127.7.113.253:40771)
I20260806 04:45:57.701781 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.700457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:42090)
0806 04:45:57.701266 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.701489 (+ 223us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":482,"threads_started":1}
W20260806 04:45:57.702111 14609 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
I20260806 04:45:57.703498 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.703179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:42094)
0806 04:45:57.703324 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.703395 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 04:45:57.703752 14609 leader_election.cc:334] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2abfd07f6b904abe93be3f40932d6c70 (127.7.113.254:41047): Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
I20260806 04:45:57.704665 15181 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2abfd07f6b904abe93be3f40932d6c70)
I20260806 04:45:57.704945 15181 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } }
I20260806 04:45:57.706333 15181 leader_election.cc:288] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2abfd07f6b904abe93be3f40932d6c70 (127.7.113.254:41047), 1296b6a5ecd24da1b5597846dfd68400 (127.7.113.252:36953)
I20260806 04:45:57.707334 15186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.706435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:42106)
0806 04:45:57.706949 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.707130 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":306,"threads_started":1}
W20260806 04:45:57.707569 14420 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
I20260806 04:45:57.709467 15186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.708929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:42118)
0806 04:45:57.709127 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.709254 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260806 04:45:57.709774 14420 leader_election.cc:334] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2abfd07f6b904abe93be3f40932d6c70 (127.7.113.254:41047): Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
I20260806 04:45:57.721131 15183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.700721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:40771 (local address 127.0.0.1:60012)
0806 04:45:57.701452 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.701470 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:57.701603 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:57.713886 (+ 12283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:57.713892 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:57.713946 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:57.714291 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:57.714303 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.715909 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.715917 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:57.718814 (+ 2897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:57.718842 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.720351 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.720357 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:57.720527 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:57.720550 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 04:45:57.720655 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 04:45:57.720784 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":473,"threads_started":1}
I20260806 04:45:57.721160 15185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.704631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60012 (local address 127.7.113.253:40771)
0806 04:45:57.713575 (+ 8944us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:57.713579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:57.713596 (+ 17us) server_negotiation.cc:407] Connection header received
0806 04:45:57.713652 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:57.713656 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:57.713716 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:57.713813 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:57.714499 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.715725 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.719056 (+ 3331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.720174 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.720323 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:57.720420 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:57.720681 (+ 261us) server_negotiation.cc:299] Negotiation successful
0806 04:45:57.720813 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":8853,"thread_start_us":9262,"threads_started":1}
I20260806 04:45:57.722103 14442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1296b6a5ecd24da1b5597846dfd68400" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ae6926d5ce374b189a76c42492abe2f7" is_pre_election: true
I20260806 04:45:57.722420 14442 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1296b6a5ecd24da1b5597846dfd68400 in term 1.
I20260806 04:45:57.722946 14606 leader_election.cc:302] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1296b6a5ecd24da1b5597846dfd68400, ae6926d5ce374b189a76c42492abe2f7; no voters: 2abfd07f6b904abe93be3f40932d6c70
I20260806 04:45:57.723371 15180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 04:45:57.723529 15180 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2abfd07f6b904abe93be3f40932d6c70)
I20260806 04:45:57.723672 15180 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 1 FOLLOWER]: Advancing to term 2
I20260806 04:45:57.724975 15188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.714447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58838 (local address 127.7.113.252:36953)
0806 04:45:57.719190 (+ 4743us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:57.719194 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:57.719218 (+ 24us) server_negotiation.cc:407] Connection header received
0806 04:45:57.719262 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:57.719265 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:57.719311 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:57.719389 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:57.719961 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.720827 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.722776 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.724021 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.724116 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:57.724200 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:57.724564 (+ 364us) server_negotiation.cc:299] Negotiation successful
0806 04:45:57.724665 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4650,"thread_start_us":4511,"threads_started":1}
I20260806 04:45:57.725003 15186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.714242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:36953 (local address 127.0.0.1:58838)
0806 04:45:57.714465 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.714484 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:57.714637 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:57.719438 (+ 4801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:57.719443 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:57.719468 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:57.719797 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:57.719808 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.720966 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.720973 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:57.722581 (+ 1608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:57.722598 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.724199 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.724206 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:57.724395 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:57.724433 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 04:45:57.724535 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 04:45:57.724676 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":3}
I20260806 04:45:57.725634 14633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae6926d5ce374b189a76c42492abe2f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1296b6a5ecd24da1b5597846dfd68400" is_pre_election: true
I20260806 04:45:57.726738 15180 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } }
I20260806 04:45:57.727164 14633 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae6926d5ce374b189a76c42492abe2f7 in current term 2: Already voted for candidate 1296b6a5ecd24da1b5597846dfd68400 in this term.
I20260806 04:45:57.727474 15180 leader_election.cc:288] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [CANDIDATE]: Term 2 election: Requested vote from peers 2abfd07f6b904abe93be3f40932d6c70 (127.7.113.254:41047), ae6926d5ce374b189a76c42492abe2f7 (127.7.113.253:40771)
I20260806 04:45:57.727988 14442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1296b6a5ecd24da1b5597846dfd68400" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ae6926d5ce374b189a76c42492abe2f7"
I20260806 04:45:57.728113 15183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.727607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:42124)
0806 04:45:57.727867 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.727961 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260806 04:45:57.728281 14442 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 1 FOLLOWER]: Advancing to term 2
I20260806 04:45:57.728317 14419 leader_election.cc:302] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae6926d5ce374b189a76c42492abe2f7; no voters: 1296b6a5ecd24da1b5597846dfd68400, 2abfd07f6b904abe93be3f40932d6c70
I20260806 04:45:57.728988 15183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.728672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:42134)
0806 04:45:57.728827 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.728891 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260806 04:45:57.729179 14609 leader_election.cc:334] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2abfd07f6b904abe93be3f40932d6c70 (127.7.113.254:41047): Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
I20260806 04:45:57.730611 14442 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1296b6a5ecd24da1b5597846dfd68400 in term 2.
I20260806 04:45:57.730763 15181 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 04:45:57.731082 14606 leader_election.cc:302] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1296b6a5ecd24da1b5597846dfd68400, ae6926d5ce374b189a76c42492abe2f7; no voters: 2abfd07f6b904abe93be3f40932d6c70
I20260806 04:45:57.731388 15180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 04:45:57.731808 15180 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [term 2 LEADER]: Becoming Leader. State: Replica: 1296b6a5ecd24da1b5597846dfd68400, State: Running, Role: LEADER
I20260806 04:45:57.732168 15180 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } }
I20260806 04:45:57.734064 15189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1296b6a5ecd24da1b5597846dfd68400. Latest consensus state: current_term: 2 leader_uuid: "1296b6a5ecd24da1b5597846dfd68400" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } } }
I20260806 04:45:57.734519 15189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:57.735222 15191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:45:57.739213 15191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:45:57.740033 15191 catalog_manager.cc:1259] Loaded cluster ID: 888aec365cc44d21aeeb9bcb509691e9
I20260806 04:45:57.740137 15191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:45:57.741441 15191 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:45:57.742322 15191 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: Loaded TSK: 0
I20260806 04:45:57.743194 15191 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:45:57.751281 14622 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58834:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:45:57.758731 14622 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:45:57.762486 15183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.762107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:42166)
0806 04:45:57.762267 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.762356 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 04:45:57.762655 14442 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [term 2 FOLLOWER]: Refusing update from remote peer 1296b6a5ecd24da1b5597846dfd68400: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260806 04:45:57.763564 15183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.763106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:42174)
0806 04:45:57.763301 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.763395 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260806 04:45:57.763471 15189 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260806 04:45:57.763749 14609 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 -> Peer 2abfd07f6b904abe93be3f40932d6c70 (127.7.113.254:41047): Couldn't send request to peer 2abfd07f6b904abe93be3f40932d6c70. Status: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 04:45:57.766103 15181 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1296b6a5ecd24da1b5597846dfd68400. Latest consensus state: current_term: 2 leader_uuid: "1296b6a5ecd24da1b5597846dfd68400" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } } }
I20260806 04:45:57.766444 15181 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:45:57.767885 15189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "1296b6a5ecd24da1b5597846dfd68400" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } } }
I20260806 04:45:57.768244 15189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400 [sys.catalog]: This master's current role is: LEADER
I20260806 04:45:57.768599 15181 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "1296b6a5ecd24da1b5597846dfd68400" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "2abfd07f6b904abe93be3f40932d6c70" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41047 } } peers { permanent_uuid: "ae6926d5ce374b189a76c42492abe2f7" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 40771 } attrs { promote: false } } peers { permanent_uuid: "1296b6a5ecd24da1b5597846dfd68400" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 36953 } attrs { promote: false } } }
I20260806 04:45:57.768885 15181 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae6926d5ce374b189a76c42492abe2f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:45:57.783270 15183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.776049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:43141 (local address 127.0.0.1:56978)
0806 04:45:57.776213 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.776233 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:57.776372 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:57.777282 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:57.777288 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:57.777311 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:57.777495 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:57.777527 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.778933 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.778939 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:57.780945 (+ 2006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:57.780965 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.782523 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.782529 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:57.782719 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:57.782753 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 04:45:57.782844 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 04:45:57.782976 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260806 04:45:57.784157 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.776806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:33369 (local address 127.0.0.1:43288)
0806 04:45:57.777407 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.777435 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:57.777591 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:57.777980 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:57.777984 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:57.778009 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:57.778305 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:57.778315 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.779827 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.779832 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:57.781842 (+ 2010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:57.781855 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.783438 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.783445 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:57.783624 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:57.783667 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 04:45:57.783727 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 04:45:57.783880 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460}
I20260806 04:45:57.784868 15198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.776494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56978 (local address 127.7.113.194:43141)
0806 04:45:57.776973 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:57.776979 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:57.777001 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:45:57.777071 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:57.777076 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:57.777148 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:57.777260 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:57.777649 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.778772 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.781171 (+ 2399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.782352 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.784075 (+ 1723us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:57.784186 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:57.784452 (+ 266us) server_negotiation.cc:299] Negotiation successful
0806 04:45:57.784597 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":244,"threads_started":1}
I20260806 04:45:57.784957 15199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.776534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43288 (local address 127.7.113.195:33369)
0806 04:45:57.776996 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:57.777002 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:57.777545 (+ 543us) server_negotiation.cc:407] Connection header received
0806 04:45:57.777730 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:57.777738 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:57.777827 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:57.778438 (+ 611us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:57.778591 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.779638 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.782036 (+ 2398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.783185 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.784385 (+ 1200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:57.784498 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:57.784545 (+ 47us) server_negotiation.cc:299] Negotiation successful
0806 04:45:57.784663 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":1177,"threads_started":1}
I20260806 04:45:57.785763 14887 tablet_service.cc:1467] Processing CreateTablet for tablet a7428499bd0b400592cfe83cade02817 (DEFAULT_TABLE table=test-table [id=02a42e3637cb4d30bad8f3cf69ab7379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:57.786206 14887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7428499bd0b400592cfe83cade02817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:57.789100 15031 tablet_service.cc:1467] Processing CreateTablet for tablet a7428499bd0b400592cfe83cade02817 (DEFAULT_TABLE table=test-table [id=02a42e3637cb4d30bad8f3cf69ab7379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:57.789572 15031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7428499bd0b400592cfe83cade02817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:57.794562 15201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.777252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44442 (local address 127.7.113.193:35253)
0806 04:45:57.788657 (+ 11405us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:57.788663 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:57.788684 (+ 21us) server_negotiation.cc:407] Connection header received
0806 04:45:57.788749 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:57.788754 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:57.788840 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:57.788981 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:45:57.789457 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.790361 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.792230 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.793512 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.793648 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:57.793752 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:57.794106 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 04:45:57.794248 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11271,"thread_start_us":11198,"threads_started":1}
I20260806 04:45:57.794868 15183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.777110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:35253 (local address 127.0.0.1:44442)
0806 04:45:57.783511 (+ 6401us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.783528 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 04:45:57.783614 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:45:57.789026 (+ 5412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:45:57.789030 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:45:57.789060 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:45:57.789245 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:57.789259 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.790491 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.790495 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:57.791987 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:45:57.792003 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:45:57.793678 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:45:57.793684 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:45:57.793914 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:57.793974 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 04:45:57.794066 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 04:45:57.794574 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6318,"thread_start_us":11144,"threads_started":1}
I20260806 04:45:57.797022 15202 tablet_bootstrap.cc:492] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec: Bootstrap starting.
I20260806 04:45:57.798977 14740 tablet_service.cc:1467] Processing CreateTablet for tablet a7428499bd0b400592cfe83cade02817 (DEFAULT_TABLE table=test-table [id=02a42e3637cb4d30bad8f3cf69ab7379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:45:57.799204 15202 tablet_bootstrap.cc:654] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:57.799467 14740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7428499bd0b400592cfe83cade02817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:45:57.799855 15203 tablet_bootstrap.cc:492] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86: Bootstrap starting.
I20260806 04:45:57.801405 15203 tablet_bootstrap.cc:654] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:57.803503 15203 tablet_bootstrap.cc:492] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86: No bootstrap required, opened a new log
I20260806 04:45:57.803647 15203 ts_tablet_manager.cc:1397] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 04:45:57.804423 15203 raft_consensus.cc:348] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:57.804685 15203 raft_consensus.cc:374] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:57.804804 15203 raft_consensus.cc:729] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d549e48698944b0783d02570ba6e1e86, State: Initialized, Role: FOLLOWER
I20260806 04:45:57.805061 15203 consensus_queue.cc:260] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:57.806327 15203 ts_tablet_manager.cc:1428] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 04:45:57.809260 14954 heartbeater.cc:503] Master 127.7.113.252:36953 was elected leader, sending a full tablet report...
I20260806 04:45:57.813122 15207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.806107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.194:56799)
0806 04:45:57.812856 (+ 6749us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.812958 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6637,"thread_start_us":6523,"threads_started":1}
I20260806 04:45:57.814095 15207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.813787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.194:58595)
0806 04:45:57.813905 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.813987 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260806 04:45:57.814505 15202 tablet_bootstrap.cc:492] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec: No bootstrap required, opened a new log
I20260806 04:45:57.814627 15202 ts_tablet_manager.cc:1397] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.011s
I20260806 04:45:57.815267 15202 raft_consensus.cc:348] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:57.815456 15202 raft_consensus.cc:374] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:57.815526 15202 raft_consensus.cc:729] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46c62df0e34242ef92aa687777c61cec, State: Initialized, Role: FOLLOWER
I20260806 04:45:57.815769 15202 consensus_queue.cc:260] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:57.816516 15202 ts_tablet_manager.cc:1428] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260806 04:45:57.816794 15208 tablet_bootstrap.cc:492] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56: Bootstrap starting.
I20260806 04:45:57.818567 15096 heartbeater.cc:503] Master 127.7.113.252:36953 was elected leader, sending a full tablet report...
I20260806 04:45:57.819126 15208 tablet_bootstrap.cc:654] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56: Neither blocks nor log segments found. Creating new log.
I20260806 04:45:57.824983 15210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.816781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.195:54309)
0806 04:45:57.824674 (+ 7893us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.824790 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7796,"thread_start_us":7705,"threads_started":1}
I20260806 04:45:57.826007 15210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.825657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.195:58429)
0806 04:45:57.825834 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.825897 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260806 04:45:57.826390 15208 tablet_bootstrap.cc:492] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56: No bootstrap required, opened a new log
I20260806 04:45:57.826535 15208 ts_tablet_manager.cc:1397] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.009s
I20260806 04:45:57.827145 15208 raft_consensus.cc:348] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:57.827318 15208 raft_consensus.cc:374] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:45:57.827461 15208 raft_consensus.cc:729] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbca05291a74430a535417c808f5b56, State: Initialized, Role: FOLLOWER
I20260806 04:45:57.827692 15208 consensus_queue.cc:260] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:57.828554 15208 ts_tablet_manager.cc:1428] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260806 04:45:57.829319 15179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.828875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.193:36043)
0806 04:45:57.829057 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.829144 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 04:45:57.830411 14807 heartbeater.cc:503] Master 127.7.113.252:36953 was elected leader, sending a full tablet report...
I20260806 04:45:57.831290 15179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.830653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.193:37791)
0806 04:45:57.831041 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.831146 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288}
I20260806 04:45:57.953909 15209 raft_consensus.cc:482] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:45:57.954152 15209 raft_consensus.cc:504] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:57.954985 15209 leader_election.cc:288] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d549e48698944b0783d02570ba6e1e86 (127.7.113.194:43141), bdbca05291a74430a535417c808f5b56 (127.7.113.193:35253)
I20260806 04:45:57.955583 14906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7428499bd0b400592cfe83cade02817" candidate_uuid: "46c62df0e34242ef92aa687777c61cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d549e48698944b0783d02570ba6e1e86" is_pre_election: true
I20260806 04:45:57.955600 14760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7428499bd0b400592cfe83cade02817" candidate_uuid: "46c62df0e34242ef92aa687777c61cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbca05291a74430a535417c808f5b56" is_pre_election: true
I20260806 04:45:57.955857 14906 raft_consensus.cc:2454] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46c62df0e34242ef92aa687777c61cec in term 0.
I20260806 04:45:57.955929 14760 raft_consensus.cc:2454] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46c62df0e34242ef92aa687777c61cec in term 0.
I20260806 04:45:57.956413 14985 leader_election.cc:302] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46c62df0e34242ef92aa687777c61cec, d549e48698944b0783d02570ba6e1e86; no voters:
I20260806 04:45:57.956744 15209 raft_consensus.cc:2781] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:45:57.956872 15209 raft_consensus.cc:482] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:45:57.957000 15209 raft_consensus.cc:3037] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:57.959060 15209 raft_consensus.cc:504] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:57.959614 15209 leader_election.cc:288] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [CANDIDATE]: Term 1 election: Requested vote from peers d549e48698944b0783d02570ba6e1e86 (127.7.113.194:43141), bdbca05291a74430a535417c808f5b56 (127.7.113.193:35253)
I20260806 04:45:57.960111 14760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7428499bd0b400592cfe83cade02817" candidate_uuid: "46c62df0e34242ef92aa687777c61cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbca05291a74430a535417c808f5b56"
I20260806 04:45:57.960155 14906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7428499bd0b400592cfe83cade02817" candidate_uuid: "46c62df0e34242ef92aa687777c61cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d549e48698944b0783d02570ba6e1e86"
I20260806 04:45:57.960410 14760 raft_consensus.cc:3037] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:57.960451 14906 raft_consensus.cc:3037] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:45:57.962425 14760 raft_consensus.cc:2454] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46c62df0e34242ef92aa687777c61cec in term 1.
I20260806 04:45:57.962575 14906 raft_consensus.cc:2454] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46c62df0e34242ef92aa687777c61cec in term 1.
I20260806 04:45:57.962904 14984 leader_election.cc:302] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46c62df0e34242ef92aa687777c61cec, bdbca05291a74430a535417c808f5b56; no voters:
I20260806 04:45:57.963213 15209 raft_consensus.cc:2781] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:45:57.963687 15209 raft_consensus.cc:686] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [term 1 LEADER]: Becoming Leader. State: Replica: 46c62df0e34242ef92aa687777c61cec, State: Running, Role: LEADER
I20260806 04:45:57.964094 15209 consensus_queue.cc:237] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } } peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } }
I20260806 04:45:57.965022 15210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:57.964250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.195:35873)
0806 04:45:57.964509 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:57.964642 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260806 04:45:57.967562 14622 catalog_manager.cc:5495] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 46c62df0e34242ef92aa687777c61cec (127.7.113.195). New cstate: current_term: 1 leader_uuid: "46c62df0e34242ef92aa687777c61cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46c62df0e34242ef92aa687777c61cec" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 33369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260806 04:45:58.026170 15199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:58.021953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43290 (local address 127.7.113.195:33369)
0806 04:45:58.022129 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:58.022134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:58.022151 (+ 17us) server_negotiation.cc:407] Connection header received
0806 04:45:58.022275 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:58.022279 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:58.022354 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:58.022431 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:45:58.022750 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:58.023433 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:58.024853 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:58.025252 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:58.025353 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:58.025664 (+ 311us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:45:58.025752 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:45:58.025816 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:58.025914 (+ 98us) server_negotiation.cc:299] Negotiation successful
0806 04:45:58.025969 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 04:45:58.029621 14760 raft_consensus.cc:1261] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56 [term 1 FOLLOWER]: Refusing update from remote peer 46c62df0e34242ef92aa687777c61cec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:58.029718 14906 raft_consensus.cc:1261] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86 [term 1 FOLLOWER]: Refusing update from remote peer 46c62df0e34242ef92aa687777c61cec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:45:58.030289 15209 consensus_queue.cc:1035] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbca05291a74430a535417c808f5b56" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:58.030567 15213 consensus_queue.cc:1035] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d549e48698944b0783d02570ba6e1e86" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 43141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:45:58.033103 15207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:58.032397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.194:59973)
0806 04:45:58.032654 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:58.032786 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260806 04:45:58.033721 15179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:58.033347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.193:36501)
0806 04:45:58.033481 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:58.033563 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 04:45:58.040870 15179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:58.040186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.193:44965)
0806 04:45:58.040527 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:58.040657 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213}
I20260806 04:45:58.047482 14623 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:58.047845 14623 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:45:58.051748 15210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:58.051212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.195:56045)
0806 04:45:58.051500 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:58.051591 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193}
I20260806 04:45:58.056023 15207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:58.055483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.7.113.194:37357)
0806 04:45:58.055793 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:58.055883 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190}
I20260806 04:45:58.056762 14623 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1296b6a5ecd24da1b5597846dfd68400: Sending DeleteTablet for 3 replicas of tablet a7428499bd0b400592cfe83cade02817
I20260806 04:45:58.057772 15031 tablet_service.cc:1514] Processing DeleteTablet for tablet a7428499bd0b400592cfe83cade02817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:58 UTC) from {username='oryx', principal='oryx/127.7.113.252@KRBTEST.COM'} at 127.0.0.1:43288
I20260806 04:45:58.058171 14887 tablet_service.cc:1514] Processing DeleteTablet for tablet a7428499bd0b400592cfe83cade02817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:58 UTC) from {username='oryx', principal='oryx/127.7.113.252@KRBTEST.COM'} at 127.0.0.1:56978
I20260806 04:45:58.058537 14740 tablet_service.cc:1514] Processing DeleteTablet for tablet a7428499bd0b400592cfe83cade02817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:58 UTC) from {username='oryx', principal='oryx/127.7.113.252@KRBTEST.COM'} at 127.0.0.1:44442
I20260806 04:45:58.058645 15224 tablet_replica.cc:330] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec: stopping tablet replica
I20260806 04:45:58.058599 14886 tablet_service.cc:1514] Processing DeleteTablet for tablet a7428499bd0b400592cfe83cade02817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:45:58 UTC) from {username='oryx', principal='oryx/127.7.113.252@KRBTEST.COM'} at 127.0.0.1:56978
I20260806 04:45:58.058847 15224 raft_consensus.cc:2229] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:45:58.059316 15225 tablet_replica.cc:330] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86: stopping tablet replica
I20260806 04:45:58.060034 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 14610
I20260806 04:45:58.063817 15224 raft_consensus.cc:2258] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:58.064251 15226 tablet_replica.cc:330] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56: stopping tablet replica
I20260806 04:45:58.064476 15226 raft_consensus.cc:2229] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:58.064754 15226 raft_consensus.cc:2258] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:58.064930 15225 raft_consensus.cc:2229] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:45:58.065657 15225 raft_consensus.cc:2258] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:45:58.065913 15226 ts_tablet_manager.cc:1905] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:58.068593 15224 ts_tablet_manager.cc:1905] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:58.069171 15225 ts_tablet_manager.cc:1905] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:45:58.072590 15226 ts_tablet_manager.cc:1918] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:45:58.072750 15226 log.cc:1196] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/a7428499bd0b400592cfe83cade02817
I20260806 04:45:58.073206 15226 ts_tablet_manager.cc:1939] T a7428499bd0b400592cfe83cade02817 P bdbca05291a74430a535417c808f5b56: Deleting consensus metadata
I20260806 04:45:58.074352 14606 catalog_manager.cc:4841] TS bdbca05291a74430a535417c808f5b56 (127.7.113.193:35253): tablet a7428499bd0b400592cfe83cade02817 (table test-table [id=02a42e3637cb4d30bad8f3cf69ab7379]) successfully deleted
I20260806 04:45:58.075415 15225 ts_tablet_manager.cc:1918] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:45:58.075584 15225 log.cc:1196] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/a7428499bd0b400592cfe83cade02817
I20260806 04:45:58.075960 15224 ts_tablet_manager.cc:1918] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:45:58.076045 15225 ts_tablet_manager.cc:1939] T a7428499bd0b400592cfe83cade02817 P d549e48698944b0783d02570ba6e1e86: Deleting consensus metadata
I20260806 04:45:58.076114 15224 log.cc:1196] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/a7428499bd0b400592cfe83cade02817
I20260806 04:45:58.076609 15224 ts_tablet_manager.cc:1939] T a7428499bd0b400592cfe83cade02817 P 46c62df0e34242ef92aa687777c61cec: Deleting consensus metadata
I20260806 04:45:58.077250 14607 catalog_manager.cc:4841] TS d549e48698944b0783d02570ba6e1e86 (127.7.113.194:43141): tablet a7428499bd0b400592cfe83cade02817 (table test-table [id=02a42e3637cb4d30bad8f3cf69ab7379]) successfully deleted
W20260806 04:45:58.077710 14607 catalog_manager.cc:4808] TS d549e48698944b0783d02570ba6e1e86 (127.7.113.194:43141): delete failed for tablet a7428499bd0b400592cfe83cade02817 because the tablet was not found. No further retry: Not found: Tablet not found: a7428499bd0b400592cfe83cade02817
I20260806 04:45:58.077795 14606 catalog_manager.cc:4841] TS 46c62df0e34242ef92aa687777c61cec (127.7.113.195:33369): tablet a7428499bd0b400592cfe83cade02817 (table test-table [id=02a42e3637cb4d30bad8f3cf69ab7379]) successfully deleted
I20260806 04:45:58.083850 15201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:58.061361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44458 (local address 127.7.113.193:35253)
0806 04:45:58.061527 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:58.061532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:58.068548 (+ 7016us) server_negotiation.cc:407] Connection header received
0806 04:45:58.068828 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:58.068833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:58.068913 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:58.068984 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:58.070938 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:58.072078 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:58.073936 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:58.074603 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:58.074699 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:58.078643 (+ 3944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:58.078679 (+ 36us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:58.078693 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:58.078728 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:58.081620 (+ 2892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:58.082235 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:58.082241 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:58.082243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:58.082378 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:58.082688 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:58.082691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:58.082693 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:58.083025 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:58.083251 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:58.083437 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 04:45:58.083623 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 04:45:58.084496 14802 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:58.179633 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 14610
I20260806 04:45:58.199172 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 14819
I20260806 04:45:58.212443 15198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:58.199917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56986 (local address 127.7.113.194:43141)
0806 04:45:58.200101 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:58.200105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:58.200125 (+ 20us) server_negotiation.cc:407] Connection header received
0806 04:45:58.200338 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:58.200342 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:58.200402 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:58.200495 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:58.201759 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:58.202453 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:58.203683 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:58.204187 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:58.204353 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:58.206835 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:58.206850 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:58.206866 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:58.206897 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:58.209714 (+ 2817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:58.210296 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:58.210303 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:58.210305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:58.210434 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:58.210796 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:58.210803 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:58.210807 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:58.211307 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:58.211557 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:58.211773 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 04:45:58.212000 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 04:45:58.213160 14949 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:58.298316 15231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:58.297561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:42184)
0806 04:45:58.298040 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:58.298145 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":271,"threads_started":1}
I20260806 04:45:58.301329 15231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:58.300986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41047 (local address 127.0.0.1:42198)
0806 04:45:58.301148 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 04:45:58.301217 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:41047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 04:45:58.310989 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 14819
I20260806 04:45:58.331079 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 14967
I20260806 04:45:58.344089 15199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:45:58.331823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43302 (local address 127.7.113.195:33369)
0806 04:45:58.331992 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 04:45:58.331997 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:45:58.332078 (+ 81us) server_negotiation.cc:407] Connection header received
0806 04:45:58.332232 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:45:58.332236 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:45:58.332357 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:45:58.332442 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:45:58.333719 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:58.334390 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:58.335545 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:45:58.335974 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:45:58.336099 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:45:58.338620 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:45:58.338635 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:45:58.338653 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:45:58.338681 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:45:58.341733 (+ 3052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:58.342355 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:58.342361 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:58.342363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:58.342482 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:45:58.342853 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:45:58.342856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:45:58.342858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:45:58.343231 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:45:58.343438 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 04:45:58.343688 (+ 250us) server_negotiation.cc:299] Negotiation successful
0806 04:45:58.343845 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 04:45:58.344851 15091 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:58.465915 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 14967
I20260806 04:45:58.490064 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 14296
I20260806 04:45:58.491196 14463 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:58.610242 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 14296
I20260806 04:45:58.633612 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 14397
I20260806 04:45:58.634681 14655 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:45:58.756800 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 14397
2026-08-06T04:45:58Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10048 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:45:58 dist-test-slave-0b58 krb5kdc[15240](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:45:58 dist-test-slave-0b58 krb5kdc[15240](info): set up 2 sockets
Aug 06 04:45:58 dist-test-slave-0b58 krb5kdc[15240](info): commencing operation
krb5kdc: starting...
W20260806 04:45:59.863395 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.003s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:46:00 dist-test-slave-0b58 krb5kdc[15240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:46:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:46:00Z Disabled control of system clock
WARNING: no policy specified for oryx/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.254.keytab.
Entry for principal oryx/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.254.keytab.
I20260806 04:46:00.110071 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:45735
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.254.keytab
--principal=oryx/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:45735
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:46:00.438042 15253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:00.438323 15253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:00.438524 15253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:00.445833 15253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:46:00.445956 15253 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 04:46:00.446043 15253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:00.446172 15253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:00.446266 15253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:46:00.446352 15253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:46:00.456492 15253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:45735
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.254.keytab
--principal=oryx/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:45735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:00.457808 15253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:00.459123 15253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:00.471225 15259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:00.471200 15262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:00.471134 15260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:00.472203 15253 server_base.cc:1034] running on GCE node
I20260806 04:46:00.472985 15253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:00.474326 15253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:00.475553 15253 hybrid_clock.cc:648] HybridClock initialized: now 1785991560475508 us; error 35 us; skew 500 ppm
I20260806 04:46:00.475839 15253 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:00 dist-test-slave-0b58 krb5kdc[15240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991560, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:00.484997 15253 init.cc:377] Logged in from keytab as oryx/127.7.113.254@KRBTEST.COM (short username oryx)
I20260806 04:46:00.486622 15253 webserver.cc:460] Webserver started at http://127.7.113.254:34659/ using document root <none> and password file <none>
I20260806 04:46:00.487366 15253 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:00.487489 15253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:00.487854 15253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:00.491048 15253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "9afd98daf7c84f1c99a7dd29d1bcb2a6"
format_stamp: "Formatted at 2026-08-06 04:46:00 on dist-test-slave-0b58"
server_key: "d96c29248ef1b50a8778bee218ef08b9"
server_key_iv: "73d4ee3124384f8f60e5f97346b4ee74"
server_key_version: "encryptionkey@0"
I20260806 04:46:00.491897 15253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "9afd98daf7c84f1c99a7dd29d1bcb2a6"
format_stamp: "Formatted at 2026-08-06 04:46:00 on dist-test-slave-0b58"
server_key: "d96c29248ef1b50a8778bee218ef08b9"
server_key_iv: "73d4ee3124384f8f60e5f97346b4ee74"
server_key_version: "encryptionkey@0"
I20260806 04:46:00.497169 15253 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 04:46:00.500737 15269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:00.502072 15253 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 04:46:00.502259 15253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "9afd98daf7c84f1c99a7dd29d1bcb2a6"
format_stamp: "Formatted at 2026-08-06 04:46:00 on dist-test-slave-0b58"
server_key: "d96c29248ef1b50a8778bee218ef08b9"
server_key_iv: "73d4ee3124384f8f60e5f97346b4ee74"
server_key_version: "encryptionkey@0"
I20260806 04:46:00.502483 15253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:00.528451 15253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:00.532482 15253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:00.532773 15253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:00.554421 15253 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:45735
I20260806 04:46:00.554441 15334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:45735 every 8 connection(s)
I20260806 04:46:00.555758 15253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:46:00.560935 15335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:00.563633 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 15253
I20260806 04:46:00.563887 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:46:00.564697 7623 external_mini_cluster.cc:1428] Setting key f346030ea4db9f20ad5294c832c52293
I20260806 04:46:00.574230 15335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6: Bootstrap starting.
I20260806 04:46:00.578094 15335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:00.579347 15335 log.cc:824] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6: Log is configured to *not* fsync() on all Append() calls
Aug 06 04:46:00 dist-test-slave-0b58 krb5kdc[15240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
I20260806 04:46:00.582737 15335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6: No bootstrap required, opened a new log
I20260806 04:46:00.589169 15338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:00.566788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38144 (local address 127.7.113.254:45735)
0806 04:46:00.567640 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:00.567652 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:00.567693 (+ 41us) server_negotiation.cc:407] Connection header received
0806 04:46:00.569423 (+ 1730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:00.569445 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:00.569802 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:00.570112 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:00.571904 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:00.573272 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:00.574982 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:00.575655 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:00.575783 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:00.580862 (+ 5079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:00.580872 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:00.580890 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:00.580935 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:00.584811 (+ 3876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:00.585448 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:00.585462 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:00.585470 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:00.585677 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:00.586033 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:00.586038 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:00.586042 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:00.586744 (+ 702us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:00.587039 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:00.587366 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 04:46:00.587794 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":370,"threads_started":1}
I20260806 04:46:00.592535 15335 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9afd98daf7c84f1c99a7dd29d1bcb2a6" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45735 } }
I20260806 04:46:00.592957 15335 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:00.593075 15335 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9afd98daf7c84f1c99a7dd29d1bcb2a6, State: Initialized, Role: FOLLOWER
I20260806 04:46:00.593784 15335 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9afd98daf7c84f1c99a7dd29d1bcb2a6" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45735 } }
I20260806 04:46:00.594113 15335 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:46:00.594323 15335 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:46:00.594556 15335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:00.596916 15335 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9afd98daf7c84f1c99a7dd29d1bcb2a6" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45735 } }
I20260806 04:46:00.597412 15335 leader_election.cc:302] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9afd98daf7c84f1c99a7dd29d1bcb2a6; no voters:
I20260806 04:46:00.597975 15335 leader_election.cc:288] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:46:00.598135 15340 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:46:00.598830 15340 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [term 1 LEADER]: Becoming Leader. State: Replica: 9afd98daf7c84f1c99a7dd29d1bcb2a6, State: Running, Role: LEADER
I20260806 04:46:00.599406 15340 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9afd98daf7c84f1c99a7dd29d1bcb2a6" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45735 } }
I20260806 04:46:00.600183 15335 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:46:00.602581 15342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9afd98daf7c84f1c99a7dd29d1bcb2a6. Latest consensus state: current_term: 1 leader_uuid: "9afd98daf7c84f1c99a7dd29d1bcb2a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9afd98daf7c84f1c99a7dd29d1bcb2a6" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45735 } } }
I20260806 04:46:00.603180 15342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [sys.catalog]: This master's current role is: LEADER
I20260806 04:46:00.602878 15341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9afd98daf7c84f1c99a7dd29d1bcb2a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9afd98daf7c84f1c99a7dd29d1bcb2a6" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45735 } } }
I20260806 04:46:00.603346 15341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6 [sys.catalog]: This master's current role is: LEADER
W20260806 04:46:00.618041 15356 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 04:46:00.618181 15356 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 04:46:00.618300 15347 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:46:00.619930 15347 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:46:00.627890 15347 catalog_manager.cc:1347] Generated new cluster ID: d1e433ef0aaa4b49b74b147cd758af46
I20260806 04:46:00.628008 15347 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:46:00.636183 15347 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:46:00.638000 15347 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:46:00.645982 15347 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6: Generated new TSK 0
I20260806 04:46:00.646917 15347 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.193.keytab.
Entry for principal oryx/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.193.keytab.
I20260806 04:46:00.713404 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45735
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.193.keytab
--principal=oryx/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:46:01.041767 15361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:01.042089 15361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:01.042269 15361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:01.049767 15361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:01.049928 15361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:01.050087 15361 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 04:46:01.050236 15361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:46:01.060012 15361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.193.keytab
--principal=oryx/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.113.254:45735
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:01.061385 15361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:01.062736 15361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:01.075460 15367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:01.075404 15366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:01.075497 15369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:01.076139 15361 server_base.cc:1034] running on GCE node
I20260806 04:46:01.076704 15361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:01.077507 15361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:01.078778 15361 hybrid_clock.cc:648] HybridClock initialized: now 1785991561078709 us; error 38 us; skew 500 ppm
I20260806 04:46:01.079066 15361 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:01 dist-test-slave-0b58 krb5kdc[15240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991561, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:01.082156 15361 init.cc:377] Logged in from keytab as oryx/127.7.113.193@KRBTEST.COM (short username oryx)
I20260806 04:46:01.083613 15361 webserver.cc:460] Webserver started at http://127.7.113.193:34489/ using document root <none> and password file <none>
I20260806 04:46:01.084398 15361 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:01.084529 15361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:01.084867 15361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:01.087808 15361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "1270a66ca41646dfa6e652c6eb5af5ef"
format_stamp: "Formatted at 2026-08-06 04:46:01 on dist-test-slave-0b58"
server_key: "65102974233d55fcead1eb5cf903aa95"
server_key_iv: "ec5f1f1de0052f0ea9125c601ac77d85"
server_key_version: "encryptionkey@0"
I20260806 04:46:01.088642 15361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "1270a66ca41646dfa6e652c6eb5af5ef"
format_stamp: "Formatted at 2026-08-06 04:46:01 on dist-test-slave-0b58"
server_key: "65102974233d55fcead1eb5cf903aa95"
server_key_iv: "ec5f1f1de0052f0ea9125c601ac77d85"
server_key_version: "encryptionkey@0"
I20260806 04:46:01.093856 15361 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:46:01.097219 15377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:01.098522 15361 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:46:01.098709 15361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "1270a66ca41646dfa6e652c6eb5af5ef"
format_stamp: "Formatted at 2026-08-06 04:46:01 on dist-test-slave-0b58"
server_key: "65102974233d55fcead1eb5cf903aa95"
server_key_iv: "ec5f1f1de0052f0ea9125c601ac77d85"
server_key_version: "encryptionkey@0"
I20260806 04:46:01.098929 15361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:01.115605 15361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:01.119571 15361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:01.119869 15361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:01.122816 15361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:01.122936 15361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:01.123070 15361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:01.123134 15361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 04:46:01 dist-test-slave-0b58 krb5kdc[15240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991561, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
I20260806 04:46:01.149080 15388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:01.123902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45735 (local address 127.7.113.193:56555)
0806 04:46:01.124718 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:01.124754 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:01.126648 (+ 1894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:01.127397 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:01.127408 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:01.128145 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:01.129043 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:01.129069 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.130477 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.130484 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:01.132707 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:01.132720 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.133804 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.133812 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:01.134142 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:01.135102 (+ 960us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:01.135127 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:01.139016 (+ 3889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:01.143208 (+ 4192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:01.143219 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:01.143241 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:01.143823 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:01.144314 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:01.144327 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:01.144333 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:01.144664 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:01.145597 (+ 933us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:01.145607 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:01.146231 (+ 624us) client_negotiation.cc:769] Sending connection context
0806 04:46:01.146604 (+ 373us) client_negotiation.cc:240] Negotiation successful
0806 04:46:01.147325 (+ 721us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":394,"threads_started":1}
I20260806 04:46:01.149247 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:01.123341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:56555 (local address 127.7.113.254:45735)
0806 04:46:01.124045 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:01.124049 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:01.124867 (+ 818us) server_negotiation.cc:407] Connection header received
0806 04:46:01.126933 (+ 2066us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:01.126941 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:01.127030 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:01.127158 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:01.129230 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.130325 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.132874 (+ 2549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.133499 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.133657 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:01.139310 (+ 5653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:01.139314 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:01.139323 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:01.139356 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:01.143038 (+ 3682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:01.143978 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:01.143985 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:01.143989 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:01.144151 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:01.144826 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:01.144834 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:01.144840 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:01.145350 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:01.145522 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:01.148373 (+ 2851us) server_negotiation.cc:299] Negotiation successful
0806 04:46:01.148734 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":477,"threads_started":1}
I20260806 04:46:01.169668 15462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:01.155005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45735 (local address 127.7.113.193:47173)
0806 04:46:01.155576 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:01.155593 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:01.155733 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:01.156065 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:01.156069 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:01.156621 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:01.157166 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:01.157181 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.158559 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.158564 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:01.159614 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:01.159625 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.160398 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.160405 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:01.160568 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:01.161284 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:01.161300 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:01.162461 (+ 1161us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:01.166579 (+ 4118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:01.166586 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:01.166591 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:01.167162 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:01.167636 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:01.167644 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:01.167653 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:01.167848 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:01.168602 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:01.168607 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:01.168775 (+ 168us) client_negotiation.cc:769] Sending connection context
0806 04:46:01.169004 (+ 229us) client_negotiation.cc:240] Negotiation successful
0806 04:46:01.169346 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":321,"threads_started":1}
I20260806 04:46:01.169929 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:01.154929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:47173 (local address 127.7.113.254:45735)
0806 04:46:01.155082 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:01.155086 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:01.155670 (+ 584us) server_negotiation.cc:407] Connection header received
0806 04:46:01.155864 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:01.155867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:01.155942 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:01.156039 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:01.157304 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.158410 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.159758 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.160185 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.160336 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:01.162694 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:01.162702 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:01.162707 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:01.162753 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:01.166420 (+ 3667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:01.167300 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:01.167308 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:01.167315 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:01.167502 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:01.168017 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:01.168021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:01.168023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:01.168365 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:01.168538 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:01.169149 (+ 611us) server_negotiation.cc:299] Negotiation successful
0806 04:46:01.169440 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 04:46:01.178433 15361 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:34105
I20260806 04:46:01.178457 15502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:34105 every 8 connection(s)
I20260806 04:46:01.179587 15361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:46:01.181537 15503 heartbeater.cc:347] Connected to a master server at 127.7.113.254:45735
I20260806 04:46:01.181753 15503 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:01.182394 15503 heartbeater.cc:511] Master 127.7.113.254:45735 requested a full tablet report, sending...
I20260806 04:46:01.184177 15288 ts_manager.cc:194] Registered new tserver with Master: 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105)
I20260806 04:46:01.185606 15288 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:56555
I20260806 04:46:01.189175 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 15361
I20260806 04:46:01.189370 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:46:01.189931 7623 external_mini_cluster.cc:1428] Setting key 4f3a035e09177fd6c0fbc176d32980bf
WARNING: no policy specified for oryx/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.194.keytab.
Entry for principal oryx/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.194.keytab.
I20260806 04:46:01.243494 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45735
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.194.keytab
--principal=oryx/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:46:01.565259 15507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:01.565573 15507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:01.565716 15507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:01.577127 15507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:01.577250 15507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:01.577379 15507 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 04:46:01.577492 15507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:46:01.586746 15507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.194.keytab
--principal=oryx/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.113.254:45735
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:01.587800 15507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:01.589085 15507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:01.602594 15512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:01.602686 15513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:01.602669 15515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:01.604290 15507 server_base.cc:1034] running on GCE node
I20260806 04:46:01.604924 15507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:01.605777 15507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:01.607015 15507 hybrid_clock.cc:648] HybridClock initialized: now 1785991561606956 us; error 38 us; skew 500 ppm
I20260806 04:46:01.607306 15507 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:01 dist-test-slave-0b58 krb5kdc[15240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991561, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:01.610443 15507 init.cc:377] Logged in from keytab as oryx/127.7.113.194@KRBTEST.COM (short username oryx)
I20260806 04:46:01.611902 15507 webserver.cc:460] Webserver started at http://127.7.113.194:42287/ using document root <none> and password file <none>
I20260806 04:46:01.612600 15507 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:01.612694 15507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:01.612952 15507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:01.615698 15507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "0e5c8ec6fda5406994e414fad41d6d09"
format_stamp: "Formatted at 2026-08-06 04:46:01 on dist-test-slave-0b58"
server_key: "1e2fbd4e5e496d3ee6b89df8cecea9ab"
server_key_iv: "09f2f039c8516387cf065788bdff4ade"
server_key_version: "encryptionkey@0"
I20260806 04:46:01.616482 15507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "0e5c8ec6fda5406994e414fad41d6d09"
format_stamp: "Formatted at 2026-08-06 04:46:01 on dist-test-slave-0b58"
server_key: "1e2fbd4e5e496d3ee6b89df8cecea9ab"
server_key_iv: "09f2f039c8516387cf065788bdff4ade"
server_key_version: "encryptionkey@0"
I20260806 04:46:01.621394 15507 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 04:46:01.624661 15523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:01.625939 15507 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 04:46:01.626058 15507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "0e5c8ec6fda5406994e414fad41d6d09"
format_stamp: "Formatted at 2026-08-06 04:46:01 on dist-test-slave-0b58"
server_key: "1e2fbd4e5e496d3ee6b89df8cecea9ab"
server_key_iv: "09f2f039c8516387cf065788bdff4ade"
server_key_version: "encryptionkey@0"
I20260806 04:46:01.626247 15507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:01.668574 15507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:01.673067 15507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:01.673296 15507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:01.675860 15507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:01.675982 15507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:01.676115 15507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:01.676187 15507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 04:46:01 dist-test-slave-0b58 krb5kdc[15240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991561, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
I20260806 04:46:01.702366 15533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:01.677350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45735 (local address 127.7.113.194:37815)
0806 04:46:01.678133 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:01.678173 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:01.680338 (+ 2165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:01.681273 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:01.681290 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:01.682048 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:01.682956 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:01.682978 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.684839 (+ 1861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.684849 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:01.687790 (+ 2941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:01.687809 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.688930 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.688941 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:01.689307 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:01.690188 (+ 881us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:01.690222 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:01.693778 (+ 3556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:01.697827 (+ 4049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:01.697840 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:01.697856 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:01.698536 (+ 680us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:01.699025 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:01.699033 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:01.699041 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:01.699310 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:01.699899 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:01.699907 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:01.700311 (+ 404us) client_negotiation.cc:769] Sending connection context
0806 04:46:01.700722 (+ 411us) client_negotiation.cc:240] Negotiation successful
0806 04:46:01.701222 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":362,"threads_started":1}
I20260806 04:46:01.703392 15532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:01.676678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:37815 (local address 127.7.113.254:45735)
0806 04:46:01.677149 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:01.677154 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:01.678286 (+ 1132us) server_negotiation.cc:407] Connection header received
0806 04:46:01.680708 (+ 2422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:01.680717 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:01.680827 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:01.680963 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:01.683172 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.684614 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.687973 (+ 3359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.688625 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.688776 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:01.694062 (+ 5286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:01.694070 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:01.694077 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:01.694126 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:01.697685 (+ 3559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:01.698679 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:01.698686 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:01.698691 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:01.698864 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:01.699438 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:01.699446 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:01.699452 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:01.699747 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:01.699917 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:01.702962 (+ 3045us) server_negotiation.cc:299] Negotiation successful
0806 04:46:01.703140 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":266,"threads_started":1}
I20260806 04:46:01.725157 15612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:01.709936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45735 (local address 127.7.113.194:60581)
0806 04:46:01.710597 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:01.710615 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:01.710732 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:01.711118 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:01.711122 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:01.711543 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:01.711894 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:01.711903 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.713485 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.713492 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:01.715164 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:01.715190 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.716276 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.716293 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:01.716418 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:01.717125 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:01.717155 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:01.718373 (+ 1218us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:01.722600 (+ 4227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:01.722604 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:01.722606 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:01.722982 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:01.723368 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:01.723375 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:01.723378 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:01.723506 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:01.724074 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:01.724079 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:01.724314 (+ 235us) client_negotiation.cc:769] Sending connection context
0806 04:46:01.724520 (+ 206us) client_negotiation.cc:240] Negotiation successful
0806 04:46:01.724828 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":355,"threads_started":1}
I20260806 04:46:01.725435 15532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:01.709914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:60581 (local address 127.7.113.254:45735)
0806 04:46:01.710138 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:01.710146 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:01.710700 (+ 554us) server_negotiation.cc:407] Connection header received
0806 04:46:01.710838 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:01.710846 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:01.710969 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:01.711101 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:01.712027 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.713332 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.715348 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:01.716018 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:01.716162 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:01.718603 (+ 2441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:01.718612 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:01.718620 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:01.718667 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:01.722486 (+ 3819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:01.723109 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:01.723116 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:01.723120 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:01.723250 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:01.723619 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:01.723624 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:01.723628 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:01.723956 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:01.724126 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:01.724645 (+ 519us) server_negotiation.cc:299] Negotiation successful
0806 04:46:01.724962 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 04:46:01.731231 15507 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:44151
I20260806 04:46:01.731300 15647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:44151 every 8 connection(s)
I20260806 04:46:01.732486 15507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:46:01.734459 15648 heartbeater.cc:347] Connected to a master server at 127.7.113.254:45735
I20260806 04:46:01.734686 15648 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:01.735523 15648 heartbeater.cc:511] Master 127.7.113.254:45735 requested a full tablet report, sending...
I20260806 04:46:01.736794 15288 ts_manager.cc:194] Registered new tserver with Master: 0e5c8ec6fda5406994e414fad41d6d09 (127.7.113.194:44151)
I20260806 04:46:01.736816 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 15507
I20260806 04:46:01.737030 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:46:01.737469 7623 external_mini_cluster.cc:1428] Setting key 3405976474634714cc92b7d2e4e48381
I20260806 04:46:01.737710 15288 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:37815
WARNING: no policy specified for oryx/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.195.keytab.
Entry for principal oryx/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.195.keytab.
I20260806 04:46:01.792327 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45735
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.195.keytab
--principal=oryx/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:46:02.119656 15652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:02.119969 15652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:02.120164 15652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:02.127894 15652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:02.128051 15652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:02.128196 15652 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 04:46:02.128363 15652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:46:02.138167 15652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.195.keytab
--principal=oryx/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.113.254:45735
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:02.139465 15652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:02.140870 15652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:02.154197 15657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:02.154335 15658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:02.154222 15660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:02.155047 15652 server_base.cc:1034] running on GCE node
I20260806 04:46:02.155587 15652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:02.156440 15652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:02.157648 15652 hybrid_clock.cc:648] HybridClock initialized: now 1785991562157575 us; error 55 us; skew 500 ppm
I20260806 04:46:02.157897 15652 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:02 dist-test-slave-0b58 krb5kdc[15240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991562, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:02.161016 15652 init.cc:377] Logged in from keytab as oryx/127.7.113.195@KRBTEST.COM (short username oryx)
I20260806 04:46:02.162369 15652 webserver.cc:460] Webserver started at http://127.7.113.195:45749/ using document root <none> and password file <none>
I20260806 04:46:02.163035 15652 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:02.163172 15652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:02.163491 15652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:02.166361 15652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "8d14b4708c6f444ba7722d7cca75eb40"
format_stamp: "Formatted at 2026-08-06 04:46:02 on dist-test-slave-0b58"
server_key: "fb7676e7b69d9f85a35d68b040d06a95"
server_key_iv: "ff8d0185ae15ec79a798699efb106b4a"
server_key_version: "encryptionkey@0"
I20260806 04:46:02.167127 15652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "8d14b4708c6f444ba7722d7cca75eb40"
format_stamp: "Formatted at 2026-08-06 04:46:02 on dist-test-slave-0b58"
server_key: "fb7676e7b69d9f85a35d68b040d06a95"
server_key_iv: "ff8d0185ae15ec79a798699efb106b4a"
server_key_version: "encryptionkey@0"
I20260806 04:46:02.171934 15652 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260806 04:46:02.175379 15668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:02.176636 15652 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 04:46:02.176802 15652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "8d14b4708c6f444ba7722d7cca75eb40"
format_stamp: "Formatted at 2026-08-06 04:46:02 on dist-test-slave-0b58"
server_key: "fb7676e7b69d9f85a35d68b040d06a95"
server_key_iv: "ff8d0185ae15ec79a798699efb106b4a"
server_key_version: "encryptionkey@0"
I20260806 04:46:02.177003 15652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:02.188019 15503 heartbeater.cc:503] Master 127.7.113.254:45735 was elected leader, sending a full tablet report...
I20260806 04:46:02.200798 15652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:02.205039 15652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:02.205317 15652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:02.208168 15652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:02.208300 15652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:02.208487 15652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:02.208580 15652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 04:46:02 dist-test-slave-0b58 krb5kdc[15240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991562, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
I20260806 04:46:02.235543 15532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:02.208628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:44489 (local address 127.7.113.254:45735)
0806 04:46:02.209752 (+ 1124us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:02.209760 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:02.210195 (+ 435us) server_negotiation.cc:407] Connection header received
0806 04:46:02.212716 (+ 2521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:02.212722 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:02.212822 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:02.212935 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:02.214341 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:02.215431 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:02.217865 (+ 2434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:02.218454 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:02.218579 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:02.225975 (+ 7396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:02.225987 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:02.225994 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:02.226076 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:02.231103 (+ 5027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:02.232194 (+ 1091us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:02.232201 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:02.232207 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:02.232414 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:02.233022 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:02.233030 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:02.233036 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:02.233467 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:02.233673 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:02.234827 (+ 1154us) server_negotiation.cc:299] Negotiation successful
0806 04:46:02.235099 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":960}
I20260806 04:46:02.238381 15677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:02.209284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45735 (local address 127.7.113.195:44489)
0806 04:46:02.210052 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:02.210086 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:02.212449 (+ 2363us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:02.213190 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:02.213197 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:02.213646 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:02.214169 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:02.214185 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:02.215583 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:02.215593 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:02.217705 (+ 2112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:02.217717 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:02.218913 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:02.218922 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:02.219223 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:02.220068 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:02.220089 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:02.225521 (+ 5432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:02.231321 (+ 5800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:02.231333 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:02.231353 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:02.232030 (+ 677us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:02.232563 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:02.232571 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:02.232577 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:02.232873 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:02.233636 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:02.233644 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:02.234242 (+ 598us) client_negotiation.cc:769] Sending connection context
0806 04:46:02.235965 (+ 1723us) client_negotiation.cc:240] Negotiation successful
0806 04:46:02.236687 (+ 722us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":412,"threads_started":1}
I20260806 04:46:02.262290 15532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:02.245787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:45299 (local address 127.7.113.254:45735)
0806 04:46:02.245954 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:02.245958 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:02.246800 (+ 842us) server_negotiation.cc:407] Connection header received
0806 04:46:02.246986 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:02.246992 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:02.247077 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:02.247183 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:02.248400 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:02.249496 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:02.251768 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:02.252456 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:02.252606 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:02.255366 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:02.255379 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:02.255383 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:02.255436 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:02.258787 (+ 3351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:02.259724 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:02.259731 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:02.259738 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:02.259915 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:02.260487 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:02.260494 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:02.260500 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:02.260910 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:02.261092 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:02.261710 (+ 618us) server_negotiation.cc:299] Negotiation successful
0806 04:46:02.261930 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 04:46:02.262398 15730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:02.245852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45735 (local address 127.7.113.195:45299)
0806 04:46:02.246668 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:02.246695 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:02.246854 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:02.247209 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:02.247214 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:02.247843 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:02.248223 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:02.248237 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:02.249622 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:02.249627 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:02.251357 (+ 1730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:02.251372 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:02.252649 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:02.252655 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:02.252931 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:02.253876 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:02.253905 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:02.255162 (+ 1257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:02.258944 (+ 3782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:02.258950 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:02.258954 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:02.259587 (+ 633us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:02.260064 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:02.260074 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:02.260078 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:02.260244 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:02.261075 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:02.261080 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:02.261389 (+ 309us) client_negotiation.cc:769] Sending connection context
0806 04:46:02.261559 (+ 170us) client_negotiation.cc:240] Negotiation successful
0806 04:46:02.261922 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":438,"threads_started":1}
I20260806 04:46:02.271610 15652 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:32835
I20260806 04:46:02.271700 15789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:32835 every 8 connection(s)
I20260806 04:46:02.272958 15652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:46:02.274884 15790 heartbeater.cc:347] Connected to a master server at 127.7.113.254:45735
I20260806 04:46:02.275068 15790 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:02.275624 15790 heartbeater.cc:511] Master 127.7.113.254:45735 requested a full tablet report, sending...
I20260806 04:46:02.277168 15288 ts_manager.cc:194] Registered new tserver with Master: 8d14b4708c6f444ba7722d7cca75eb40 (127.7.113.195:32835)
I20260806 04:46:02.277999 15288 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:44489
I20260806 04:46:02.283138 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 15652
I20260806 04:46:02.283299 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:46:02.283658 7623 external_mini_cluster.cc:1428] Setting key d15c5ccd9cb7b5af8977429a6afa40bf
I20260806 04:46:02.286515 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 04:46:02 dist-test-slave-0b58 krb5kdc[15240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991562, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 04:46:02 dist-test-slave-0b58 krb5kdc[15240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:02 dist-test-slave-0b58 krb5kdc[15240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:02.740238 15648 heartbeater.cc:503] Master 127.7.113.254:45735 was elected leader, sending a full tablet report...
I20260806 04:46:03.280431 15790 heartbeater.cc:503] Master 127.7.113.254:45735 was elected leader, sending a full tablet report...
W20260806 04:46:03.427784 15798 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.089s user 0.004s sys 0.015s
W20260806 04:46:03.429095 15532 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:02.333234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43900 (local address 127.7.113.254:45735)
0806 04:46:02.333424 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:02.333429 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:02.333634 (+ 205us) server_negotiation.cc:407] Connection header received
0806 04:46:02.333787 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:02.333791 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:02.333858 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:02.333948 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:02.335245 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:02.335954 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:02.337201 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:02.337595 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:02.337705 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.428795 (+1091090us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43900: BlockingRecv error: recv got EOF from 127.0.0.1:43900 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 06 04:46:03 dist-test-slave-0b58 krb5kdc[15240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991562, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
I20260806 04:46:03.446326 15532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.433228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43904 (local address 127.7.113.254:45735)
0806 04:46:03.433403 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:03.433408 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:03.433759 (+ 351us) server_negotiation.cc:407] Connection header received
0806 04:46:03.433914 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:03.433918 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:03.433995 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:03.434081 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:03.435249 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.436013 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.437292 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.437715 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.437811 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.441536 (+ 3725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:03.441541 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:03.441545 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:03.441576 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:03.443974 (+ 2398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:03.444664 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:03.444667 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:03.444669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:03.444784 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:03.445112 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:03.445115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:03.445117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:03.445376 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:03.445568 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:03.445806 (+ 238us) server_negotiation.cc:299] Negotiation successful
0806 04:46:03.445957 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 04:46:03.450239 15288 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43904:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:46:03.457232 15288 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:46:03.481828 15810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.468415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60230 (local address 127.7.113.195:32835)
0806 04:46:03.468992 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:03.469002 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:03.469727 (+ 725us) server_negotiation.cc:407] Connection header received
0806 04:46:03.470532 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:03.470545 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:03.470840 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:03.471059 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:46:03.472181 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.474139 (+ 1958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.477826 (+ 3687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.479805 (+ 1979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.479950 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.480219 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:03.481125 (+ 906us) server_negotiation.cc:299] Negotiation successful
0806 04:46:03.481380 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":412,"threads_started":1}
I20260806 04:46:03.483141 15809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.468207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:32835 (local address 127.0.0.1:60230)
0806 04:46:03.469578 (+ 1371us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:03.469622 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:03.470270 (+ 648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:03.471408 (+ 1138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:03.471419 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:03.471459 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:46:03.471954 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.471968 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.474411 (+ 2443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.474419 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.477591 (+ 3172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.477612 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.480493 (+ 2881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.480502 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.480809 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.480880 (+ 71us) client_negotiation.cc:769] Sending connection context
0806 04:46:03.482207 (+ 1327us) client_negotiation.cc:240] Negotiation successful
0806 04:46:03.482498 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1049,"spinlock_wait_cycles":915328,"thread_start_us":916,"threads_started":1}
I20260806 04:46:03.492120 15719 tablet_service.cc:1467] Processing CreateTablet for tablet bbf7bd137e444e9dbb21ed7732a948e0 (DEFAULT_TABLE table=test-table [id=df4ced74d22b420184d23672ed8c5a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:03.493640 15719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbf7bd137e444e9dbb21ed7732a948e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:03.494065 15812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.469061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:44151 (local address 127.0.0.1:53206)
0806 04:46:03.469734 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:03.469750 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:03.470082 (+ 332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:03.487772 (+ 17690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:03.487780 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:03.487818 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:46:03.488411 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.488427 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.489991 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.489998 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.491436 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.491448 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.493290 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.493296 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.493463 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.493497 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 04:46:03.493593 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 04:46:03.493728 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":372,"threads_started":1}
I20260806 04:46:03.494109 15811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.468656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53206 (local address 127.7.113.194:44151)
0806 04:46:03.487028 (+ 18372us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:03.487040 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:03.487078 (+ 38us) server_negotiation.cc:407] Connection header received
0806 04:46:03.487196 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:03.487207 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:03.487505 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:03.487745 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:46:03.488641 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.489864 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.491609 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.493060 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.493212 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.493415 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:03.493651 (+ 236us) server_negotiation.cc:299] Negotiation successful
0806 04:46:03.493831 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17443,"thread_start_us":17856,"threads_started":1}
I20260806 04:46:03.495630 15809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.469917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:34105 (local address 127.0.0.1:58848)
0806 04:46:03.483540 (+ 13623us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:03.483564 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:03.483692 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:03.489337 (+ 5645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:03.489343 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:03.489367 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:46:03.489563 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.489572 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.491368 (+ 1796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.491374 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.493174 (+ 1800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.493190 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.494931 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.494937 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.495113 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.495146 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 04:46:03.495232 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 04:46:03.495361 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13483,"thread_start_us":18252,"threads_started":1}
I20260806 04:46:03.496935 15814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.470172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58848 (local address 127.7.113.193:34105)
0806 04:46:03.488803 (+ 18631us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:03.488811 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:03.488838 (+ 27us) server_negotiation.cc:407] Connection header received
0806 04:46:03.488922 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:03.488929 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:03.489138 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:03.489320 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:46:03.489708 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.491194 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.493380 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.494759 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.494920 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.496405 (+ 1485us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:03.496470 (+ 65us) server_negotiation.cc:299] Negotiation successful
0806 04:46:03.496622 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18469,"thread_start_us":18326,"threads_started":1}
I20260806 04:46:03.497268 15576 tablet_service.cc:1467] Processing CreateTablet for tablet bbf7bd137e444e9dbb21ed7732a948e0 (DEFAULT_TABLE table=test-table [id=df4ced74d22b420184d23672ed8c5a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:03.498524 15576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbf7bd137e444e9dbb21ed7732a948e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:03.500358 15432 tablet_service.cc:1467] Processing CreateTablet for tablet bbf7bd137e444e9dbb21ed7732a948e0 (DEFAULT_TABLE table=test-table [id=df4ced74d22b420184d23672ed8c5a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:03.501642 15432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbf7bd137e444e9dbb21ed7732a948e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:03.506644 15815 tablet_bootstrap.cc:492] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40: Bootstrap starting.
I20260806 04:46:03.510262 15815 tablet_bootstrap.cc:654] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:03.511369 15815 log.cc:824] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40: Log is configured to *not* fsync() on all Append() calls
I20260806 04:46:03.513927 15815 tablet_bootstrap.cc:492] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40: No bootstrap required, opened a new log
I20260806 04:46:03.514189 15815 ts_tablet_manager.cc:1397] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 04:46:03.516505 15818 tablet_bootstrap.cc:492] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef: Bootstrap starting.
I20260806 04:46:03.520849 15817 tablet_bootstrap.cc:492] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09: Bootstrap starting.
I20260806 04:46:03.520892 15818 tablet_bootstrap.cc:654] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:03.522130 15818 log.cc:824] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef: Log is configured to *not* fsync() on all Append() calls
I20260806 04:46:03.523558 15817 tablet_bootstrap.cc:654] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:03.524223 15815 raft_consensus.cc:348] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } }
I20260806 04:46:03.524663 15815 raft_consensus.cc:374] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:03.524811 15815 raft_consensus.cc:729] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d14b4708c6f444ba7722d7cca75eb40, State: Initialized, Role: FOLLOWER
I20260806 04:46:03.524936 15817 log.cc:824] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09: Log is configured to *not* fsync() on all Append() calls
I20260806 04:46:03.525554 15815 consensus_queue.cc:260] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } }
I20260806 04:46:03.526636 15818 tablet_bootstrap.cc:492] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef: No bootstrap required, opened a new log
I20260806 04:46:03.526978 15818 ts_tablet_manager.cc:1397] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260806 04:46:03.537813 15815 ts_tablet_manager.cc:1428] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40: Time spent starting tablet: real 0.023s user 0.015s sys 0.008s
I20260806 04:46:03.539172 15817 tablet_bootstrap.cc:492] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09: No bootstrap required, opened a new log
I20260806 04:46:03.539471 15817 ts_tablet_manager.cc:1397] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.012s
I20260806 04:46:03.540048 15818 raft_consensus.cc:348] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } }
I20260806 04:46:03.540546 15818 raft_consensus.cc:374] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:03.540661 15818 raft_consensus.cc:729] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1270a66ca41646dfa6e652c6eb5af5ef, State: Initialized, Role: FOLLOWER
I20260806 04:46:03.541357 15818 consensus_queue.cc:260] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } }
I20260806 04:46:03.543371 15818 ts_tablet_manager.cc:1428] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef: Time spent starting tablet: real 0.016s user 0.008s sys 0.008s
I20260806 04:46:03.548612 15817 raft_consensus.cc:348] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } }
I20260806 04:46:03.548985 15817 raft_consensus.cc:374] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:03.549098 15817 raft_consensus.cc:729] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e5c8ec6fda5406994e414fad41d6d09, State: Initialized, Role: FOLLOWER
I20260806 04:46:03.549646 15817 consensus_queue.cc:260] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } }
I20260806 04:46:03.551340 15817 ts_tablet_manager.cc:1428] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09: Time spent starting tablet: real 0.012s user 0.008s sys 0.003s
I20260806 04:46:03.615861 15821 raft_consensus.cc:482] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:46:03.616197 15821 raft_consensus.cc:504] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } }
I20260806 04:46:03.617941 15821 leader_election.cc:288] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e5c8ec6fda5406994e414fad41d6d09 (127.7.113.194:44151), 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105)
I20260806 04:46:03.625020 15814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.618561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:37089 (local address 127.7.113.193:34105)
0806 04:46:03.618812 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:03.618819 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:03.619217 (+ 398us) server_negotiation.cc:407] Connection header received
0806 04:46:03.619507 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:03.619514 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:03.619594 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:03.619696 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:46:03.620342 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.621385 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.623349 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.624113 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.624309 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.624389 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:03.624646 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 04:46:03.624766 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 04:46:03.625191 15824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.618384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:34105 (local address 127.7.113.195:37089)
0806 04:46:03.619096 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:03.619115 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:03.619307 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:03.619722 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:03.619725 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:03.619747 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:46:03.620165 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.620177 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.621533 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.621539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.623195 (+ 1656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.623206 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.624342 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.624348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.624493 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.624516 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 04:46:03.624619 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 04:46:03.624737 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":3,"thread_start_us":370,"threads_started":1}
I20260806 04:46:03.625319 15825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.618994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:44151 (local address 127.7.113.195:57075)
0806 04:46:03.619711 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:03.619730 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:03.619855 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:03.620199 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:03.620202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:03.620219 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:46:03.620678 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.620692 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.621977 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.621982 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.623380 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.623391 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.624501 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.624507 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.624650 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.624671 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 04:46:03.624771 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 04:46:03.624908 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"mutex_wait_us":42,"thread_start_us":352,"threads_started":1}
I20260806 04:46:03.625174 15811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.618423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:57075 (local address 127.7.113.194:44151)
0806 04:46:03.618696 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:03.618706 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:03.619824 (+ 1118us) server_negotiation.cc:407] Connection header received
0806 04:46:03.619994 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:03.619998 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:03.620078 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:03.620174 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:46:03.620851 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.621832 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.623528 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.624235 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.624469 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.624542 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:03.624795 (+ 253us) server_negotiation.cc:299] Negotiation successful
0806 04:46:03.624922 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 04:46:03.626317 15452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbf7bd137e444e9dbb21ed7732a948e0" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" is_pre_election: true
I20260806 04:46:03.626335 15597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbf7bd137e444e9dbb21ed7732a948e0" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e5c8ec6fda5406994e414fad41d6d09" is_pre_election: true
I20260806 04:46:03.626766 15452 raft_consensus.cc:2454] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 0.
I20260806 04:46:03.626778 15597 raft_consensus.cc:2454] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 0.
I20260806 04:46:03.627351 15669 leader_election.cc:302] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1270a66ca41646dfa6e652c6eb5af5ef, 8d14b4708c6f444ba7722d7cca75eb40; no voters:
I20260806 04:46:03.627774 15821 raft_consensus.cc:2781] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:46:03.627897 15821 raft_consensus.cc:482] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:46:03.627969 15821 raft_consensus.cc:3037] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:03.630290 15821 raft_consensus.cc:504] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } }
I20260806 04:46:03.630913 15821 leader_election.cc:288] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 election: Requested vote from peers 0e5c8ec6fda5406994e414fad41d6d09 (127.7.113.194:44151), 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105)
I20260806 04:46:03.631320 15597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbf7bd137e444e9dbb21ed7732a948e0" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e5c8ec6fda5406994e414fad41d6d09"
I20260806 04:46:03.631522 15597 raft_consensus.cc:3037] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:03.631465 15452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbf7bd137e444e9dbb21ed7732a948e0" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1270a66ca41646dfa6e652c6eb5af5ef"
I20260806 04:46:03.631702 15452 raft_consensus.cc:3037] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:03.633795 15597 raft_consensus.cc:2454] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 1.
I20260806 04:46:03.633952 15452 raft_consensus.cc:2454] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 1.
I20260806 04:46:03.634195 15671 leader_election.cc:302] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e5c8ec6fda5406994e414fad41d6d09, 8d14b4708c6f444ba7722d7cca75eb40; no voters:
I20260806 04:46:03.634486 15821 raft_consensus.cc:2781] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:46:03.634887 15821 raft_consensus.cc:686] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 LEADER]: Becoming Leader. State: Replica: 8d14b4708c6f444ba7722d7cca75eb40, State: Running, Role: LEADER
I20260806 04:46:03.635417 15821 consensus_queue.cc:237] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } }
I20260806 04:46:03.640101 15288 catalog_manager.cc:5495] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d14b4708c6f444ba7722d7cca75eb40 (127.7.113.195). New cstate: current_term: 1 leader_uuid: "8d14b4708c6f444ba7722d7cca75eb40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } health_report { overall_health: UNKNOWN } } }
I20260806 04:46:03.669970 15810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.665137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60234 (local address 127.7.113.195:32835)
0806 04:46:03.665334 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:03.665339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:03.665481 (+ 142us) server_negotiation.cc:407] Connection header received
0806 04:46:03.665677 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:03.665681 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:03.665763 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:03.665886 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:46:03.666191 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.666875 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.668112 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.668511 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.668596 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.668991 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:46:03.669489 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:46:03.669591 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:03.669696 (+ 105us) server_negotiation.cc:299] Negotiation successful
0806 04:46:03.669756 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 04:46:03.677557 15597 raft_consensus.cc:1261] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Refusing update from remote peer 8d14b4708c6f444ba7722d7cca75eb40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:46:03.677580 15452 raft_consensus.cc:1261] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Refusing update from remote peer 8d14b4708c6f444ba7722d7cca75eb40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:46:03.678527 15826 consensus_queue.cc:1035] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:46:03.678855 15821 consensus_queue.cc:1035] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 04:46:03.682943 15504 tablet.cc:2369] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:46:03.691743 15829 mvcc.cc:205] Tried to move back new op lower bound from 7315421444814254080 to 7315421444654632960. Current Snapshot: MvccSnapshot[applied={T|T < 7315421444814254080}]
I20260806 04:46:03.693329 15830 mvcc.cc:205] Tried to move back new op lower bound from 7315421444814254080 to 7315421444654632960. Current Snapshot: MvccSnapshot[applied={T|T < 7315421444814254080}]
I20260806 04:46:03.697310 15831 mvcc.cc:205] Tried to move back new op lower bound from 7315421444814254080 to 7315421444654632960. Current Snapshot: MvccSnapshot[applied={T|T < 7315421444814254080}]
I20260806 04:46:03.704658 15288 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43904:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:46:03.704937 15288 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43904:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:46:03.708714 15288 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6: Sending DeleteTablet for 3 replicas of tablet bbf7bd137e444e9dbb21ed7732a948e0
I20260806 04:46:03.709761 15719 tablet_service.cc:1514] Processing DeleteTablet for tablet bbf7bd137e444e9dbb21ed7732a948e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:03 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:60230
I20260806 04:46:03.709887 15576 tablet_service.cc:1514] Processing DeleteTablet for tablet bbf7bd137e444e9dbb21ed7732a948e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:03 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:53206
I20260806 04:46:03.710690 15838 tablet_replica.cc:330] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40: stopping tablet replica
I20260806 04:46:03.711009 15432 tablet_service.cc:1514] Processing DeleteTablet for tablet bbf7bd137e444e9dbb21ed7732a948e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:03 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:58848
I20260806 04:46:03.711162 15838 raft_consensus.cc:2229] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:46:03.711755 15838 raft_consensus.cc:2258] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:03.713186 15288 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43904:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:46:03.713867 15288 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:46:03.716099 15838 ts_tablet_manager.cc:1905] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:46:03.722471 15840 tablet_replica.cc:330] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef: stopping tablet replica
I20260806 04:46:03.723152 15840 raft_consensus.cc:2229] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:46:03.727026 15575 tablet_service.cc:1467] Processing CreateTablet for tablet 8ef755f1d77d400288b48d464b829f29 (DEFAULT_TABLE table=test-table [id=9616b484084646e28bce76bd62c862f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:03.727620 15575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ef755f1d77d400288b48d464b829f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:03.728773 15839 tablet_replica.cc:330] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09: stopping tablet replica
I20260806 04:46:03.728765 15719 tablet_service.cc:1467] Processing CreateTablet for tablet 8ef755f1d77d400288b48d464b829f29 (DEFAULT_TABLE table=test-table [id=9616b484084646e28bce76bd62c862f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:03.729208 15719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ef755f1d77d400288b48d464b829f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:03.729182 15839 raft_consensus.cc:2229] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:46:03.729681 15839 raft_consensus.cc:2258] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:03.731000 15838 ts_tablet_manager.cc:1918] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:46:03.731172 15838 log.cc:1196] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/bbf7bd137e444e9dbb21ed7732a948e0
I20260806 04:46:03.731657 15839 ts_tablet_manager.cc:1905] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:46:03.731716 15838 ts_tablet_manager.cc:1939] T bbf7bd137e444e9dbb21ed7732a948e0 P 8d14b4708c6f444ba7722d7cca75eb40: Deleting consensus metadata
I20260806 04:46:03.733419 15270 catalog_manager.cc:4841] TS 8d14b4708c6f444ba7722d7cca75eb40 (127.7.113.195:32835): tablet bbf7bd137e444e9dbb21ed7732a948e0 (table test-table [id=df4ced74d22b420184d23672ed8c5a3e]) successfully deleted
I20260806 04:46:03.734601 15817 tablet_bootstrap.cc:492] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09: Bootstrap starting.
I20260806 04:46:03.736459 15817 tablet_bootstrap.cc:654] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:03.737013 15432 tablet_service.cc:1467] Processing CreateTablet for tablet 8ef755f1d77d400288b48d464b829f29 (DEFAULT_TABLE table=test-table [id=9616b484084646e28bce76bd62c862f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:03.739259 15839 ts_tablet_manager.cc:1918] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:46:03.739460 15839 log.cc:1196] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/bbf7bd137e444e9dbb21ed7732a948e0
I20260806 04:46:03.739676 15432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ef755f1d77d400288b48d464b829f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:03.740159 15839 ts_tablet_manager.cc:1939] T bbf7bd137e444e9dbb21ed7732a948e0 P 0e5c8ec6fda5406994e414fad41d6d09: Deleting consensus metadata
I20260806 04:46:03.746260 15815 tablet_bootstrap.cc:492] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40: Bootstrap starting.
I20260806 04:46:03.748469 15815 tablet_bootstrap.cc:654] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:03.749738 15840 raft_consensus.cc:2258] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:03.750964 15817 tablet_bootstrap.cc:492] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09: No bootstrap required, opened a new log
I20260806 04:46:03.751148 15817 ts_tablet_manager.cc:1397] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.011s
I20260806 04:46:03.752673 15840 ts_tablet_manager.cc:1905] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:46:03.752705 15817 raft_consensus.cc:348] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.752954 15817 raft_consensus.cc:374] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:03.753079 15817 raft_consensus.cc:729] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e5c8ec6fda5406994e414fad41d6d09, State: Initialized, Role: FOLLOWER
I20260806 04:46:03.753412 15817 consensus_queue.cc:260] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.753903 15272 catalog_manager.cc:4841] TS 0e5c8ec6fda5406994e414fad41d6d09 (127.7.113.194:44151): tablet bbf7bd137e444e9dbb21ed7732a948e0 (table test-table [id=df4ced74d22b420184d23672ed8c5a3e]) successfully deleted
I20260806 04:46:03.754094 15817 ts_tablet_manager.cc:1428] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 04:46:03.755908 15815 tablet_bootstrap.cc:492] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40: No bootstrap required, opened a new log
I20260806 04:46:03.756080 15815 ts_tablet_manager.cc:1397] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.005s
I20260806 04:46:03.757061 15815 raft_consensus.cc:348] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.757308 15815 raft_consensus.cc:374] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:03.757434 15815 raft_consensus.cc:729] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d14b4708c6f444ba7722d7cca75eb40, State: Initialized, Role: FOLLOWER
I20260806 04:46:03.757786 15815 consensus_queue.cc:260] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.758198 15818 tablet_bootstrap.cc:492] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef: Bootstrap starting.
I20260806 04:46:03.759914 15818 tablet_bootstrap.cc:654] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:03.761286 15815 ts_tablet_manager.cc:1428] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260806 04:46:03.768148 15840 ts_tablet_manager.cc:1918] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:46:03.768405 15840 log.cc:1196] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/bbf7bd137e444e9dbb21ed7732a948e0
I20260806 04:46:03.769003 15840 ts_tablet_manager.cc:1939] T bbf7bd137e444e9dbb21ed7732a948e0 P 1270a66ca41646dfa6e652c6eb5af5ef: Deleting consensus metadata
I20260806 04:46:03.769325 15818 tablet_bootstrap.cc:492] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef: No bootstrap required, opened a new log
I20260806 04:46:03.769486 15818 ts_tablet_manager.cc:1397] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.001s
I20260806 04:46:03.770151 15818 raft_consensus.cc:348] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.770351 15818 raft_consensus.cc:374] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:03.770457 15818 raft_consensus.cc:729] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1270a66ca41646dfa6e652c6eb5af5ef, State: Initialized, Role: FOLLOWER
I20260806 04:46:03.770756 15818 consensus_queue.cc:260] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.770900 15270 catalog_manager.cc:4841] TS 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105): tablet bbf7bd137e444e9dbb21ed7732a948e0 (table test-table [id=df4ced74d22b420184d23672ed8c5a3e]) successfully deleted
I20260806 04:46:03.771422 15818 ts_tablet_manager.cc:1428] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260806 04:46:03.775620 15791 tablet.cc:2369] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:46:03.793146 15821 raft_consensus.cc:482] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:46:03.793344 15821 raft_consensus.cc:504] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.794094 15821 leader_election.cc:288] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105), 0e5c8ec6fda5406994e414fad41d6d09 (127.7.113.194:44151)
I20260806 04:46:03.794623 15595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ef755f1d77d400288b48d464b829f29" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e5c8ec6fda5406994e414fad41d6d09" is_pre_election: true
I20260806 04:46:03.794644 15452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ef755f1d77d400288b48d464b829f29" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" is_pre_election: true
I20260806 04:46:03.794903 15452 raft_consensus.cc:2454] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 0.
I20260806 04:46:03.794914 15595 raft_consensus.cc:2454] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 0.
I20260806 04:46:03.795328 15669 leader_election.cc:302] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1270a66ca41646dfa6e652c6eb5af5ef, 8d14b4708c6f444ba7722d7cca75eb40; no voters:
I20260806 04:46:03.795634 15821 raft_consensus.cc:2781] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:46:03.795769 15821 raft_consensus.cc:482] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:46:03.795892 15821 raft_consensus.cc:3037] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:03.798063 15821 raft_consensus.cc:504] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.798626 15821 leader_election.cc:288] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 election: Requested vote from peers 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105), 0e5c8ec6fda5406994e414fad41d6d09 (127.7.113.194:44151)
I20260806 04:46:03.799170 15595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ef755f1d77d400288b48d464b829f29" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e5c8ec6fda5406994e414fad41d6d09"
I20260806 04:46:03.799160 15452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ef755f1d77d400288b48d464b829f29" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1270a66ca41646dfa6e652c6eb5af5ef"
I20260806 04:46:03.799365 15595 raft_consensus.cc:3037] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:03.799388 15452 raft_consensus.cc:3037] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:03.802074 15452 raft_consensus.cc:2454] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 1.
I20260806 04:46:03.802472 15595 raft_consensus.cc:2454] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 1.
I20260806 04:46:03.802507 15669 leader_election.cc:302] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1270a66ca41646dfa6e652c6eb5af5ef, 8d14b4708c6f444ba7722d7cca75eb40; no voters:
I20260806 04:46:03.802850 15821 raft_consensus.cc:2781] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:46:03.803014 15821 raft_consensus.cc:686] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 LEADER]: Becoming Leader. State: Replica: 8d14b4708c6f444ba7722d7cca75eb40, State: Running, Role: LEADER
I20260806 04:46:03.803619 15821 consensus_queue.cc:237] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.806564 15288 catalog_manager.cc:5495] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d14b4708c6f444ba7722d7cca75eb40 (127.7.113.195). New cstate: current_term: 1 leader_uuid: "8d14b4708c6f444ba7722d7cca75eb40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } health_report { overall_health: HEALTHY } } }
Aug 06 04:46:03 dist-test-slave-0b58 krb5kdc[15240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991560, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.254@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
I20260806 04:46:03.865159 15532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.850802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43916 (local address 127.7.113.254:45735)
0806 04:46:03.851039 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:03.851043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:03.851614 (+ 571us) server_negotiation.cc:407] Connection header received
0806 04:46:03.851821 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:03.851826 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:03.851916 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:03.852007 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:03.853193 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.853928 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.855265 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.855987 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.856124 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.859684 (+ 3560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:03.859689 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:03.859693 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:03.859721 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:03.862321 (+ 2600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:03.863156 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:03.863159 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:03.863162 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:03.863277 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:03.863674 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:03.863677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:03.863679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:03.863933 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:03.864039 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:03.864544 (+ 505us) server_negotiation.cc:299] Negotiation successful
0806 04:46:03.864878 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":149,"server-negotiator.queue_time_us":96}
I20260806 04:46:03.865284 15851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.850881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45735 (local address 127.0.0.1:43916)
0806 04:46:03.851509 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:03.851525 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:03.851690 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:03.852032 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:03.852037 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:03.852781 (+ 744us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:03.853047 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.853057 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.854062 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.854069 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.855092 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.855110 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.856166 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.856170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.856355 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.857007 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:03.857029 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:03.859466 (+ 2437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:03.862458 (+ 2992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:03.862471 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:03.862480 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:03.863039 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:03.863381 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:03.863386 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:03.863390 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:03.863570 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:03.864056 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:03.864064 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:03.864277 (+ 213us) client_negotiation.cc:769] Sending connection context
0806 04:46:03.864464 (+ 187us) client_negotiation.cc:240] Negotiation successful
0806 04:46:03.864747 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":342,"threads_started":1}
I20260806 04:46:03.870505 15288 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:43916:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 04:46:03.871724 15288 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:46:03.878698 15432 tablet_service.cc:1467] Processing CreateTablet for tablet 4efb861a9f2a4be7bc0ef32235c2416b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=970f12d8b6134acfa412645750fa8a29]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 04:46:03.878849 15576 tablet_service.cc:1467] Processing CreateTablet for tablet 4efb861a9f2a4be7bc0ef32235c2416b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=970f12d8b6134acfa412645750fa8a29]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 04:46:03.879313 15432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4efb861a9f2a4be7bc0ef32235c2416b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:03.879410 15576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4efb861a9f2a4be7bc0ef32235c2416b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:03.884971 15719 tablet_service.cc:1467] Processing CreateTablet for tablet 4efb861a9f2a4be7bc0ef32235c2416b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=970f12d8b6134acfa412645750fa8a29]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 04:46:03.885396 15719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4efb861a9f2a4be7bc0ef32235c2416b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:03.886722 15817 tablet_bootstrap.cc:492] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09: Bootstrap starting.
I20260806 04:46:03.888455 15817 tablet_bootstrap.cc:654] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:03.889652 15818 tablet_bootstrap.cc:492] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef: Bootstrap starting.
I20260806 04:46:03.891311 15818 tablet_bootstrap.cc:654] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:03.892331 15815 tablet_bootstrap.cc:492] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40: Bootstrap starting.
I20260806 04:46:03.893909 15818 tablet_bootstrap.cc:492] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef: No bootstrap required, opened a new log
I20260806 04:46:03.894023 15815 tablet_bootstrap.cc:654] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:03.894068 15818 ts_tablet_manager.cc:1397] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260806 04:46:03.894851 15818 raft_consensus.cc:348] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.895121 15818 raft_consensus.cc:374] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:03.895206 15818 raft_consensus.cc:729] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1270a66ca41646dfa6e652c6eb5af5ef, State: Initialized, Role: FOLLOWER
I20260806 04:46:03.895470 15818 consensus_queue.cc:260] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.895754 15817 tablet_bootstrap.cc:492] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09: No bootstrap required, opened a new log
I20260806 04:46:03.895910 15817 ts_tablet_manager.cc:1397] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.003s
I20260806 04:46:03.895923 15822 tablet_replica.cc:439] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } }
I20260806 04:46:03.896243 15822 tablet_replica.cc:442] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:46:03.896658 15817 raft_consensus.cc:348] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.896876 15817 raft_consensus.cc:374] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:03.896953 15817 raft_consensus.cc:729] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e5c8ec6fda5406994e414fad41d6d09, State: Initialized, Role: FOLLOWER
I20260806 04:46:03.897197 15817 consensus_queue.cc:260] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.897847 15817 ts_tablet_manager.cc:1428] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260806 04:46:03.897670 15823 tablet_replica.cc:439] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } }
I20260806 04:46:03.898068 15823 tablet_replica.cc:442] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:46:03.898959 15818 ts_tablet_manager.cc:1428] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260806 04:46:03.901057 15815 tablet_bootstrap.cc:492] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40: No bootstrap required, opened a new log
I20260806 04:46:03.901250 15815 ts_tablet_manager.cc:1397] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.004s
I20260806 04:46:03.902072 15815 raft_consensus.cc:348] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.902379 15815 raft_consensus.cc:374] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:03.902462 15815 raft_consensus.cc:729] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d14b4708c6f444ba7722d7cca75eb40, State: Initialized, Role: FOLLOWER
I20260806 04:46:03.902753 15815 consensus_queue.cc:260] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.903235 15821 tablet_replica.cc:439] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } }
I20260806 04:46:03.903445 15815 ts_tablet_manager.cc:1428] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260806 04:46:03.903563 15821 tablet_replica.cc:442] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:46:03.912982 15821 raft_consensus.cc:482] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:46:03.913182 15821 raft_consensus.cc:504] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.913795 15821 leader_election.cc:288] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105), 0e5c8ec6fda5406994e414fad41d6d09 (127.7.113.194:44151)
I20260806 04:46:03.914269 15452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4efb861a9f2a4be7bc0ef32235c2416b" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" is_pre_election: true
I20260806 04:46:03.914362 15595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4efb861a9f2a4be7bc0ef32235c2416b" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e5c8ec6fda5406994e414fad41d6d09" is_pre_election: true
I20260806 04:46:03.914538 15452 raft_consensus.cc:2454] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 0.
I20260806 04:46:03.914597 15595 raft_consensus.cc:2454] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 0.
I20260806 04:46:03.914969 15669 leader_election.cc:302] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1270a66ca41646dfa6e652c6eb5af5ef, 8d14b4708c6f444ba7722d7cca75eb40; no voters:
I20260806 04:46:03.915241 15821 raft_consensus.cc:2781] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:46:03.915347 15821 raft_consensus.cc:482] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:46:03.915468 15821 raft_consensus.cc:3037] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:03.918668 15821 raft_consensus.cc:504] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.919327 15821 leader_election.cc:288] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 election: Requested vote from peers 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105), 0e5c8ec6fda5406994e414fad41d6d09 (127.7.113.194:44151)
I20260806 04:46:03.919651 15452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4efb861a9f2a4be7bc0ef32235c2416b" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1270a66ca41646dfa6e652c6eb5af5ef"
I20260806 04:46:03.919870 15452 raft_consensus.cc:3037] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:03.920027 15595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4efb861a9f2a4be7bc0ef32235c2416b" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e5c8ec6fda5406994e414fad41d6d09"
I20260806 04:46:03.920343 15595 raft_consensus.cc:3037] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:03.922322 15595 raft_consensus.cc:2454] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 1.
I20260806 04:46:03.922693 15671 leader_election.cc:302] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e5c8ec6fda5406994e414fad41d6d09, 8d14b4708c6f444ba7722d7cca75eb40; no voters:
I20260806 04:46:03.922776 15452 raft_consensus.cc:2454] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 1.
I20260806 04:46:03.922984 15821 raft_consensus.cc:2781] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:46:03.923230 15821 raft_consensus.cc:686] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 LEADER]: Becoming Leader. State: Replica: 8d14b4708c6f444ba7722d7cca75eb40, State: Running, Role: LEADER
I20260806 04:46:03.923543 15821 consensus_queue.cc:237] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:03.925220 15826 tablet_replica.cc:439] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40: TxnStatusTablet state changed. Reason: New leader 8d14b4708c6f444ba7722d7cca75eb40. Latest consensus state: current_term: 1 leader_uuid: "8d14b4708c6f444ba7722d7cca75eb40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } }
I20260806 04:46:03.925570 15826 tablet_replica.cc:442] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40: This TxnStatusTablet replica's current role is: LEADER
I20260806 04:46:03.926307 15856 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 04:46:03.926582 15856 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 04:46:03.927140 15286 catalog_manager.cc:5495] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d14b4708c6f444ba7722d7cca75eb40 (127.7.113.195). New cstate: current_term: 1 leader_uuid: "8d14b4708c6f444ba7722d7cca75eb40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260806 04:46:03.948351 15810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.942666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60236 (local address 127.7.113.195:32835)
0806 04:46:03.942871 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:03.942878 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:03.943097 (+ 219us) server_negotiation.cc:407] Connection header received
0806 04:46:03.943331 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:03.943335 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:03.943412 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:03.943485 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:46:03.943890 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.944708 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.946607 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.947009 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.947096 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.947618 (+ 522us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:46:03.947729 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:46:03.947810 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:03.947979 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 04:46:03.948041 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 04:46:03.948452 15851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.942738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:32835 (local address 127.0.0.1:60236)
0806 04:46:03.942988 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:03.943009 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:03.943164 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:03.943540 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:03.943546 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:03.943558 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 04:46:03.943762 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.943773 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.944834 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.944840 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.946466 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.946481 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.947155 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.947162 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.947388 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.947457 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 04:46:03.947847 (+ 390us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 04:46:03.947867 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 04:46:03.947955 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 04:46:03.948110 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 04:46:03.951869 15595 raft_consensus.cc:1261] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Refusing update from remote peer 8d14b4708c6f444ba7722d7cca75eb40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:46:03.952069 15452 raft_consensus.cc:1261] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Refusing update from remote peer 8d14b4708c6f444ba7722d7cca75eb40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:46:03.952652 15826 consensus_queue.cc:1035] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:46:03.952936 15821 consensus_queue.cc:1035] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:46:03.961555 15823 tablet_replica.cc:439] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09: TxnStatusTablet state changed. Reason: New leader 8d14b4708c6f444ba7722d7cca75eb40. Latest consensus state: current_term: 1 leader_uuid: "8d14b4708c6f444ba7722d7cca75eb40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } }
I20260806 04:46:03.961838 15823 tablet_replica.cc:442] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:46:03.962934 15822 tablet_replica.cc:439] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef: TxnStatusTablet state changed. Reason: New leader 8d14b4708c6f444ba7722d7cca75eb40. Latest consensus state: current_term: 1 leader_uuid: "8d14b4708c6f444ba7722d7cca75eb40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } }
I20260806 04:46:03.963227 15822 tablet_replica.cc:442] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:46:03.963438 15821 tablet_replica.cc:439] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8d14b4708c6f444ba7722d7cca75eb40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } }
I20260806 04:46:03.963711 15821 tablet_replica.cc:442] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40: This TxnStatusTablet replica's current role is: LEADER
I20260806 04:46:03.965494 15823 tablet_replica.cc:439] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8d14b4708c6f444ba7722d7cca75eb40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } }
I20260806 04:46:03.965693 15823 tablet_replica.cc:442] T 4efb861a9f2a4be7bc0ef32235c2416b P 0e5c8ec6fda5406994e414fad41d6d09: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:46:03.965904 15826 tablet_replica.cc:439] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8d14b4708c6f444ba7722d7cca75eb40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } }
I20260806 04:46:03.966120 15826 tablet_replica.cc:442] T 4efb861a9f2a4be7bc0ef32235c2416b P 8d14b4708c6f444ba7722d7cca75eb40: This TxnStatusTablet replica's current role is: LEADER
I20260806 04:46:03.967495 15822 tablet_replica.cc:439] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8d14b4708c6f444ba7722d7cca75eb40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } } }
I20260806 04:46:03.967729 15822 tablet_replica.cc:442] T 4efb861a9f2a4be7bc0ef32235c2416b P 1270a66ca41646dfa6e652c6eb5af5ef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 04:46:03.986016 15810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.979575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:51897 (local address 127.7.113.195:32835)
0806 04:46:03.979775 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:03.979782 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:03.980570 (+ 788us) server_negotiation.cc:407] Connection header received
0806 04:46:03.980720 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:03.980726 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:03.980807 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:03.980911 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:46:03.981455 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.982656 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.984076 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.984761 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.984892 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.985306 (+ 414us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:46:03.985445 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:46:03.985532 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:03.985654 (+ 122us) server_negotiation.cc:299] Negotiation successful
0806 04:46:03.985727 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260806 04:46:03.986398 15649 tablet.cc:2369] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:46:03.986231 15863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:03.979706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:32835 (local address 127.7.113.195:51897)
0806 04:46:03.980461 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:03.980482 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:03.980597 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:03.980930 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:03.980933 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:03.980942 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 04:46:03.981296 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.981308 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.982771 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.982774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.983939 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:03.983950 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:03.984931 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:03.984936 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:03.985078 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:03.985131 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 04:46:03.985537 (+ 406us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 04:46:03.985545 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 04:46:03.985609 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 04:46:03.985703 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":386,"threads_started":1}
I20260806 04:46:03.996086 15452 raft_consensus.cc:1261] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Refusing update from remote peer 8d14b4708c6f444ba7722d7cca75eb40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:46:03.996239 15595 raft_consensus.cc:1261] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Refusing update from remote peer 8d14b4708c6f444ba7722d7cca75eb40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:46:03.996750 15826 consensus_queue.cc:1035] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:46:03.997195 15821 consensus_queue.cc:1035] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:46:04.054780 15287 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43904:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:46:04.054986 15287 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43904:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:46:04.058029 15287 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6: Sending DeleteTablet for 3 replicas of tablet 8ef755f1d77d400288b48d464b829f29
I20260806 04:46:04.058768 15432 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ef755f1d77d400288b48d464b829f29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:04 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:58848
I20260806 04:46:04.058871 15576 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ef755f1d77d400288b48d464b829f29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:04 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:53206
I20260806 04:46:04.059060 15840 tablet_replica.cc:330] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef: stopping tablet replica
I20260806 04:46:04.059128 15718 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ef755f1d77d400288b48d464b829f29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:04 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:60230
I20260806 04:46:04.059265 15840 raft_consensus.cc:2229] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:46:04.059414 15839 tablet_replica.cc:330] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09: stopping tablet replica
I20260806 04:46:04.059458 15840 raft_consensus.cc:2258] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:04.059615 15839 raft_consensus.cc:2229] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:46:04.059700 15838 tablet_replica.cc:330] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40: stopping tablet replica
I20260806 04:46:04.059806 15839 raft_consensus.cc:2258] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:04.059911 15838 raft_consensus.cc:2229] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:46:04.060210 15838 raft_consensus.cc:2258] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:04.060910 15839 ts_tablet_manager.cc:1905] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:46:04.062279 15838 ts_tablet_manager.cc:1905] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:46:04.062418 15840 ts_tablet_manager.cc:1905] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:46:04.068146 15839 ts_tablet_manager.cc:1918] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:46:04.068313 15839 log.cc:1196] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/8ef755f1d77d400288b48d464b829f29
I20260806 04:46:04.068729 15839 ts_tablet_manager.cc:1939] T 8ef755f1d77d400288b48d464b829f29 P 0e5c8ec6fda5406994e414fad41d6d09: Deleting consensus metadata
I20260806 04:46:04.069693 15838 ts_tablet_manager.cc:1918] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:46:04.069866 15838 log.cc:1196] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/8ef755f1d77d400288b48d464b829f29
I20260806 04:46:04.069938 15272 catalog_manager.cc:4841] TS 0e5c8ec6fda5406994e414fad41d6d09 (127.7.113.194:44151): tablet 8ef755f1d77d400288b48d464b829f29 (table test-table [id=9616b484084646e28bce76bd62c862f6]) successfully deleted
I20260806 04:46:04.070307 15838 ts_tablet_manager.cc:1939] T 8ef755f1d77d400288b48d464b829f29 P 8d14b4708c6f444ba7722d7cca75eb40: Deleting consensus metadata
I20260806 04:46:04.071426 15270 catalog_manager.cc:4841] TS 8d14b4708c6f444ba7722d7cca75eb40 (127.7.113.195:32835): tablet 8ef755f1d77d400288b48d464b829f29 (table test-table [id=9616b484084646e28bce76bd62c862f6]) successfully deleted
I20260806 04:46:04.072557 15840 ts_tablet_manager.cc:1918] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:46:04.072703 15840 log.cc:1196] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/8ef755f1d77d400288b48d464b829f29
I20260806 04:46:04.073129 15840 ts_tablet_manager.cc:1939] T 8ef755f1d77d400288b48d464b829f29 P 1270a66ca41646dfa6e652c6eb5af5ef: Deleting consensus metadata
I20260806 04:46:04.073973 15270 catalog_manager.cc:4841] TS 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105): tablet 8ef755f1d77d400288b48d464b829f29 (table test-table [id=9616b484084646e28bce76bd62c862f6]) successfully deleted
Aug 06 04:46:04 dist-test-slave-0b58 krb5kdc[15240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 04:46:04 dist-test-slave-0b58 krb5kdc[15240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:04 dist-test-slave-0b58 krb5kdc[15240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
W20260806 04:46:04.131404 15532 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:04.119018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43930 (local address 127.7.113.254:45735)
0806 04:46:04.119256 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:04.119263 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:04.119621 (+ 358us) server_negotiation.cc:407] Connection header received
0806 04:46:04.119793 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:04.119798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:04.119889 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:04.120012 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:04.121383 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.122561 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.123855 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.124539 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.124676 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:04.131202 (+ 6526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43930: BlockingRecv error: recv got EOF from 127.0.0.1:43930 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 06 04:46:04 dist-test-slave-0b58 krb5kdc[15240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM
I20260806 04:46:04.150218 15532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:04.135102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43946 (local address 127.7.113.254:45735)
0806 04:46:04.135308 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:04.135314 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:04.135583 (+ 269us) server_negotiation.cc:407] Connection header received
0806 04:46:04.135789 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:04.135792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:04.135849 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:04.135926 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:04.137479 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.138175 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.139975 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.140412 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.140499 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:04.144913 (+ 4414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:04.144918 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:04.144921 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:04.144952 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:04.147571 (+ 2619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:04.148218 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:04.148224 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:04.148227 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:04.148416 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:04.148797 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:04.148803 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:04.148806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:04.149095 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:04.149343 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:04.149633 (+ 290us) server_negotiation.cc:299] Negotiation successful
0806 04:46:04.149876 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 04:46:04.153887 15287 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43946:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:46:04.154618 15287 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:46:04.161585 15432 tablet_service.cc:1467] Processing CreateTablet for tablet 75e99497cb0441b1b9c9580411f90677 (DEFAULT_TABLE table=test-table [id=bbeb199eb3594bd2a452ccb8f7dae3c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:04.161825 15576 tablet_service.cc:1467] Processing CreateTablet for tablet 75e99497cb0441b1b9c9580411f90677 (DEFAULT_TABLE table=test-table [id=bbeb199eb3594bd2a452ccb8f7dae3c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:04.162047 15432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75e99497cb0441b1b9c9580411f90677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:04.162210 15576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75e99497cb0441b1b9c9580411f90677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:04.162111 15718 tablet_service.cc:1467] Processing CreateTablet for tablet 75e99497cb0441b1b9c9580411f90677 (DEFAULT_TABLE table=test-table [id=bbeb199eb3594bd2a452ccb8f7dae3c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:04.162580 15718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75e99497cb0441b1b9c9580411f90677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:04.168442 15818 tablet_bootstrap.cc:492] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef: Bootstrap starting.
I20260806 04:46:04.169873 15818 tablet_bootstrap.cc:654] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:04.170274 15815 tablet_bootstrap.cc:492] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40: Bootstrap starting.
I20260806 04:46:04.171260 15817 tablet_bootstrap.cc:492] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09: Bootstrap starting.
I20260806 04:46:04.172392 15815 tablet_bootstrap.cc:654] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:04.172964 15817 tablet_bootstrap.cc:654] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:04.182320 15817 tablet_bootstrap.cc:492] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09: No bootstrap required, opened a new log
I20260806 04:46:04.182544 15817 ts_tablet_manager.cc:1397] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20260806 04:46:04.183501 15817 raft_consensus.cc:348] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.183907 15817 raft_consensus.cc:374] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:04.184062 15817 raft_consensus.cc:729] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e5c8ec6fda5406994e414fad41d6d09, State: Initialized, Role: FOLLOWER
I20260806 04:46:04.184403 15817 consensus_queue.cc:260] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.185197 15817 ts_tablet_manager.cc:1428] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 04:46:04.187626 15815 tablet_bootstrap.cc:492] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40: No bootstrap required, opened a new log
I20260806 04:46:04.187863 15815 ts_tablet_manager.cc:1397] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.007s
I20260806 04:46:04.189049 15818 tablet_bootstrap.cc:492] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef: No bootstrap required, opened a new log
I20260806 04:46:04.189194 15818 ts_tablet_manager.cc:1397] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.008s
I20260806 04:46:04.188843 15815 raft_consensus.cc:348] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.189940 15815 raft_consensus.cc:374] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:04.190114 15815 raft_consensus.cc:729] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d14b4708c6f444ba7722d7cca75eb40, State: Initialized, Role: FOLLOWER
I20260806 04:46:04.190464 15815 consensus_queue.cc:260] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.190546 15818 raft_consensus.cc:348] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.190825 15818 raft_consensus.cc:374] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:04.190912 15818 raft_consensus.cc:729] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1270a66ca41646dfa6e652c6eb5af5ef, State: Initialized, Role: FOLLOWER
I20260806 04:46:04.191141 15818 consensus_queue.cc:260] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.192090 15818 ts_tablet_manager.cc:1428] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260806 04:46:04.194768 15815 ts_tablet_manager.cc:1428] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260806 04:46:04.307183 15823 raft_consensus.cc:482] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:46:04.307452 15823 raft_consensus.cc:504] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.309219 15823 leader_election.cc:288] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105), 8d14b4708c6f444ba7722d7cca75eb40 (127.7.113.195:32835)
I20260806 04:46:04.318418 15810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:04.310736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:39839 (local address 127.7.113.195:32835)
0806 04:46:04.310929 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:04.310934 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:04.311031 (+ 97us) server_negotiation.cc:407] Connection header received
0806 04:46:04.311404 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:04.311411 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:04.311511 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:04.311615 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:46:04.312528 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.313279 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.316116 (+ 2837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.317523 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.317688 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:04.317776 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:04.317986 (+ 210us) server_negotiation.cc:299] Negotiation successful
0806 04:46:04.318117 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 04:46:04.318545 15886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:04.310278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:32835 (local address 127.7.113.194:39839)
0806 04:46:04.310925 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:04.310951 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:04.311124 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:04.311825 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:04.311830 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:04.311859 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:46:04.312358 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:04.312376 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.313423 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.313432 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:04.315931 (+ 2499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:04.315946 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.317699 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.317703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:04.317824 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:04.317850 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 04:46:04.317957 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 04:46:04.318085 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"mutex_wait_us":172,"thread_start_us":349,"threads_started":1}
I20260806 04:46:04.319675 15740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e99497cb0441b1b9c9580411f90677" candidate_uuid: "0e5c8ec6fda5406994e414fad41d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d14b4708c6f444ba7722d7cca75eb40" is_pre_election: true
I20260806 04:46:04.320195 15740 raft_consensus.cc:2454] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e5c8ec6fda5406994e414fad41d6d09 in term 0.
I20260806 04:46:04.320552 15884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:04.309492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:34105 (local address 127.7.113.194:55025)
0806 04:46:04.310228 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:04.310250 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:04.310377 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:04.311520 (+ 1143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:04.311525 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:04.311549 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:46:04.311946 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:04.311959 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.313519 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.313524 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:04.315931 (+ 2407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:04.315946 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.319624 (+ 3678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.319633 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:04.319827 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:04.319866 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 04:46:04.319967 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 04:46:04.320095 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"mutex_wait_us":80,"thread_start_us":356,"threads_started":1}
I20260806 04:46:04.320617 15885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:04.309546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:55025 (local address 127.7.113.193:34105)
0806 04:46:04.311184 (+ 1638us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:04.311192 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:04.311212 (+ 20us) server_negotiation.cc:407] Connection header received
0806 04:46:04.311292 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:04.311300 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:04.311385 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:04.311502 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:46:04.312137 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.313386 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.317878 (+ 4492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.319181 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.319415 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:04.319488 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:04.320016 (+ 528us) server_negotiation.cc:299] Negotiation successful
0806 04:46:04.320161 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1507,"thread_start_us":1383,"threads_started":1}
I20260806 04:46:04.321013 15524 leader_election.cc:302] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e5c8ec6fda5406994e414fad41d6d09, 8d14b4708c6f444ba7722d7cca75eb40; no voters:
I20260806 04:46:04.321290 15452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e99497cb0441b1b9c9580411f90677" candidate_uuid: "0e5c8ec6fda5406994e414fad41d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" is_pre_election: true
I20260806 04:46:04.321478 15823 raft_consensus.cc:2781] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:46:04.321522 15452 raft_consensus.cc:2454] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e5c8ec6fda5406994e414fad41d6d09 in term 0.
I20260806 04:46:04.321611 15823 raft_consensus.cc:482] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:46:04.321708 15823 raft_consensus.cc:3037] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:04.324018 15823 raft_consensus.cc:504] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.324664 15823 leader_election.cc:288] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [CANDIDATE]: Term 1 election: Requested vote from peers 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105), 8d14b4708c6f444ba7722d7cca75eb40 (127.7.113.195:32835)
I20260806 04:46:04.325045 15452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e99497cb0441b1b9c9580411f90677" candidate_uuid: "0e5c8ec6fda5406994e414fad41d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1270a66ca41646dfa6e652c6eb5af5ef"
I20260806 04:46:04.325263 15452 raft_consensus.cc:3037] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:04.325230 15740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e99497cb0441b1b9c9580411f90677" candidate_uuid: "0e5c8ec6fda5406994e414fad41d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d14b4708c6f444ba7722d7cca75eb40"
I20260806 04:46:04.325430 15740 raft_consensus.cc:3037] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:04.327318 15452 raft_consensus.cc:2454] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e5c8ec6fda5406994e414fad41d6d09 in term 1.
I20260806 04:46:04.327711 15524 leader_election.cc:302] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e5c8ec6fda5406994e414fad41d6d09, 1270a66ca41646dfa6e652c6eb5af5ef; no voters:
I20260806 04:46:04.327984 15823 raft_consensus.cc:2781] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:46:04.328537 15823 raft_consensus.cc:686] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 LEADER]: Becoming Leader. State: Replica: 0e5c8ec6fda5406994e414fad41d6d09, State: Running, Role: LEADER
I20260806 04:46:04.328783 15740 raft_consensus.cc:2454] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e5c8ec6fda5406994e414fad41d6d09 in term 1.
I20260806 04:46:04.329389 15823 consensus_queue.cc:237] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.333225 15287 catalog_manager.cc:5495] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e5c8ec6fda5406994e414fad41d6d09 (127.7.113.194). New cstate: current_term: 1 leader_uuid: "0e5c8ec6fda5406994e414fad41d6d09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260806 04:46:04.385191 15890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:04.378622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53216 (local address 127.7.113.194:44151)
0806 04:46:04.379537 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:04.379542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:04.379560 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:46:04.379643 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:04.379647 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:04.379723 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:04.379918 (+ 195us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:46:04.380369 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.381107 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.382736 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.383224 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.383388 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:04.383879 (+ 491us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:46:04.384534 (+ 655us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:46:04.384686 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:04.384798 (+ 112us) server_negotiation.cc:299] Negotiation successful
0806 04:46:04.384878 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":811,"thread_start_us":641,"threads_started":1}
I20260806 04:46:04.388958 15452 raft_consensus.cc:1261] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Refusing update from remote peer 0e5c8ec6fda5406994e414fad41d6d09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:46:04.389124 15740 raft_consensus.cc:1261] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Refusing update from remote peer 0e5c8ec6fda5406994e414fad41d6d09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:46:04.389775 15887 consensus_queue.cc:1035] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:46:04.390172 15823 consensus_queue.cc:1035] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:46:04.406818 15287 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:46:04.407064 15287 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:46:04.410501 15287 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6: Sending DeleteTablet for 3 replicas of tablet 75e99497cb0441b1b9c9580411f90677
I20260806 04:46:04.411612 15432 tablet_service.cc:1514] Processing DeleteTablet for tablet 75e99497cb0441b1b9c9580411f90677 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:04 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:58848
I20260806 04:46:04.411932 15576 tablet_service.cc:1514] Processing DeleteTablet for tablet 75e99497cb0441b1b9c9580411f90677 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:04 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:53206
I20260806 04:46:04.412226 15840 tablet_replica.cc:330] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef: stopping tablet replica
I20260806 04:46:04.412421 15840 raft_consensus.cc:2229] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:46:04.412592 15840 pending_rounds.cc:62] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef: Trying to abort 2 pending ops.
I20260806 04:46:04.412679 15840 pending_rounds.cc:68] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7315421447729659904 op_type: WRITE_OP write_request { tablet_id: "75e99497cb0441b1b9c9580411f90677" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\270\245\320\323\006\"8\n\ntest-admin\022*\n bbeb199eb3594bd2a452ccb8f7dae3c2\020\001\030\001 \001(\001" signature: "<redacted>""y\2115\361\226B\013x\035\372\234\223\356;\212\246S\306y\336\352>\366\267\340\273\\\023\373\020\035\216)r\350\307u\0259\t\327\310\031\252\007\016\017?\260@T\252\262\371e\375o\310\322e\356*\243{" signing_key_seq_num: 0 } } request_id { client_id: "7c0e5b34279543ec908454a859e28eb3" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260806 04:46:04.413410 15840 pending_rounds.cc:68] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315421447497383936 op_type: NO_OP noop_request { }
I20260806 04:46:04.413544 15840 raft_consensus.cc:2866] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260806 04:46:04.413672 15840 raft_consensus.cc:2258] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:04.413959 15839 tablet_replica.cc:330] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09: stopping tablet replica
I20260806 04:46:04.413820 15287 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43946:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 04:46:04.414130 15839 raft_consensus.cc:2229] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 LEADER]: Raft consensus shutting down.
W20260806 04:46:04.414463 15287 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:46:04.414593 15839 raft_consensus.cc:2258] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:04.416936 15718 tablet_service.cc:1514] Processing DeleteTablet for tablet 75e99497cb0441b1b9c9580411f90677 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:04 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:60230
I20260806 04:46:04.417273 15838 tablet_replica.cc:330] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40: stopping tablet replica
I20260806 04:46:04.417476 15838 raft_consensus.cc:2229] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:46:04.417753 15838 raft_consensus.cc:2258] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:04.418766 15839 ts_tablet_manager.cc:1905] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:46:04.425818 15839 ts_tablet_manager.cc:1918] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:46:04.425957 15839 log.cc:1196] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/75e99497cb0441b1b9c9580411f90677
I20260806 04:46:04.426445 15839 ts_tablet_manager.cc:1939] T 75e99497cb0441b1b9c9580411f90677 P 0e5c8ec6fda5406994e414fad41d6d09: Deleting consensus metadata
I20260806 04:46:04.427099 15432 tablet_service.cc:1467] Processing CreateTablet for tablet 9933b6b67cb44728a72abe1813a6d9ba (DEFAULT_TABLE table=test-table [id=a3218b076d254d1fbf2fb4c9cb1cfd01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:04.427517 15432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9933b6b67cb44728a72abe1813a6d9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:04.432637 15718 tablet_service.cc:1467] Processing CreateTablet for tablet 9933b6b67cb44728a72abe1813a6d9ba (DEFAULT_TABLE table=test-table [id=a3218b076d254d1fbf2fb4c9cb1cfd01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:04.433056 15718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9933b6b67cb44728a72abe1813a6d9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:04.434485 15838 ts_tablet_manager.cc:1905] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:46:04.436401 15272 catalog_manager.cc:4841] TS 0e5c8ec6fda5406994e414fad41d6d09 (127.7.113.194:44151): tablet 75e99497cb0441b1b9c9580411f90677 (table test-table [id=bbeb199eb3594bd2a452ccb8f7dae3c2]) successfully deleted
I20260806 04:46:04.436920 15576 tablet_service.cc:1467] Processing CreateTablet for tablet 9933b6b67cb44728a72abe1813a6d9ba (DEFAULT_TABLE table=test-table [id=a3218b076d254d1fbf2fb4c9cb1cfd01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:04.437315 15576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9933b6b67cb44728a72abe1813a6d9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:04.439337 15838 ts_tablet_manager.cc:1918] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:46:04.439491 15838 log.cc:1196] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/75e99497cb0441b1b9c9580411f90677
I20260806 04:46:04.440027 15838 ts_tablet_manager.cc:1939] T 75e99497cb0441b1b9c9580411f90677 P 8d14b4708c6f444ba7722d7cca75eb40: Deleting consensus metadata
I20260806 04:46:04.441187 15270 catalog_manager.cc:4841] TS 8d14b4708c6f444ba7722d7cca75eb40 (127.7.113.195:32835): tablet 75e99497cb0441b1b9c9580411f90677 (table test-table [id=bbeb199eb3594bd2a452ccb8f7dae3c2]) successfully deleted
I20260806 04:46:04.441396 15840 ts_tablet_manager.cc:1905] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:46:04.448051 15817 tablet_bootstrap.cc:492] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09: Bootstrap starting.
I20260806 04:46:04.450083 15817 tablet_bootstrap.cc:654] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:04.453243 15818 tablet_bootstrap.cc:492] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef: Bootstrap starting.
I20260806 04:46:04.454990 15818 tablet_bootstrap.cc:654] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:04.457091 15840 ts_tablet_manager.cc:1918] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:46:04.457216 15840 log.cc:1196] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/75e99497cb0441b1b9c9580411f90677
I20260806 04:46:04.457631 15840 ts_tablet_manager.cc:1939] T 75e99497cb0441b1b9c9580411f90677 P 1270a66ca41646dfa6e652c6eb5af5ef: Deleting consensus metadata
I20260806 04:46:04.460543 15815 tablet_bootstrap.cc:492] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40: Bootstrap starting.
I20260806 04:46:04.462116 15815 tablet_bootstrap.cc:654] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:04.467188 15818 tablet_bootstrap.cc:492] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef: No bootstrap required, opened a new log
I20260806 04:46:04.467396 15818 ts_tablet_manager.cc:1397] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.005s
I20260806 04:46:04.468050 15270 catalog_manager.cc:4841] TS 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105): tablet 75e99497cb0441b1b9c9580411f90677 (table test-table [id=bbeb199eb3594bd2a452ccb8f7dae3c2]) successfully deleted
I20260806 04:46:04.468293 15818 raft_consensus.cc:348] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.468649 15818 raft_consensus.cc:374] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:04.468765 15818 raft_consensus.cc:729] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1270a66ca41646dfa6e652c6eb5af5ef, State: Initialized, Role: FOLLOWER
I20260806 04:46:04.469096 15818 consensus_queue.cc:260] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.470418 15818 ts_tablet_manager.cc:1428] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260806 04:46:04.476722 15817 tablet_bootstrap.cc:492] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09: No bootstrap required, opened a new log
I20260806 04:46:04.476976 15817 ts_tablet_manager.cc:1397] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.001s
I20260806 04:46:04.477685 15815 tablet_bootstrap.cc:492] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40: No bootstrap required, opened a new log
I20260806 04:46:04.477875 15815 ts_tablet_manager.cc:1397] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.005s
I20260806 04:46:04.477773 15817 raft_consensus.cc:348] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.478070 15817 raft_consensus.cc:374] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:04.478161 15817 raft_consensus.cc:729] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e5c8ec6fda5406994e414fad41d6d09, State: Initialized, Role: FOLLOWER
I20260806 04:46:04.478426 15817 consensus_queue.cc:260] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.478634 15815 raft_consensus.cc:348] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.478916 15815 raft_consensus.cc:374] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:04.478961 15817 ts_tablet_manager.cc:1428] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260806 04:46:04.478992 15815 raft_consensus.cc:729] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d14b4708c6f444ba7722d7cca75eb40, State: Initialized, Role: FOLLOWER
I20260806 04:46:04.479354 15815 consensus_queue.cc:260] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.480127 15815 ts_tablet_manager.cc:1428] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260806 04:46:04.611068 15866 raft_consensus.cc:482] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:46:04.611301 15866 raft_consensus.cc:504] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.612197 15866 leader_election.cc:288] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105), 0e5c8ec6fda5406994e414fad41d6d09 (127.7.113.194:44151)
I20260806 04:46:04.612802 15452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9933b6b67cb44728a72abe1813a6d9ba" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" is_pre_election: true
I20260806 04:46:04.613062 15452 raft_consensus.cc:2454] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 0.
I20260806 04:46:04.613271 15597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9933b6b67cb44728a72abe1813a6d9ba" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e5c8ec6fda5406994e414fad41d6d09" is_pre_election: true
I20260806 04:46:04.613507 15597 raft_consensus.cc:2454] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 0.
I20260806 04:46:04.614049 15671 leader_election.cc:302] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e5c8ec6fda5406994e414fad41d6d09, 8d14b4708c6f444ba7722d7cca75eb40; no voters:
I20260806 04:46:04.614451 15866 raft_consensus.cc:2781] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:46:04.614581 15866 raft_consensus.cc:482] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:46:04.614676 15866 raft_consensus.cc:3037] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:04.617856 15866 raft_consensus.cc:504] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.618834 15866 leader_election.cc:288] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 election: Requested vote from peers 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105), 0e5c8ec6fda5406994e414fad41d6d09 (127.7.113.194:44151)
I20260806 04:46:04.618881 15452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9933b6b67cb44728a72abe1813a6d9ba" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1270a66ca41646dfa6e652c6eb5af5ef"
I20260806 04:46:04.619105 15452 raft_consensus.cc:3037] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:04.620594 15597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9933b6b67cb44728a72abe1813a6d9ba" candidate_uuid: "8d14b4708c6f444ba7722d7cca75eb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e5c8ec6fda5406994e414fad41d6d09"
I20260806 04:46:04.620810 15597 raft_consensus.cc:3037] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:04.622243 15452 raft_consensus.cc:2454] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 1.
I20260806 04:46:04.622701 15669 leader_election.cc:302] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1270a66ca41646dfa6e652c6eb5af5ef, 8d14b4708c6f444ba7722d7cca75eb40; no voters:
I20260806 04:46:04.623085 15866 raft_consensus.cc:2781] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:46:04.624032 15597 raft_consensus.cc:2454] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d14b4708c6f444ba7722d7cca75eb40 in term 1.
I20260806 04:46:04.628515 15866 raft_consensus.cc:686] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 LEADER]: Becoming Leader. State: Replica: 8d14b4708c6f444ba7722d7cca75eb40, State: Running, Role: LEADER
I20260806 04:46:04.628829 15866 consensus_queue.cc:237] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } }
I20260806 04:46:04.631892 15286 catalog_manager.cc:5495] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d14b4708c6f444ba7722d7cca75eb40 (127.7.113.195). New cstate: current_term: 1 leader_uuid: "8d14b4708c6f444ba7722d7cca75eb40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d14b4708c6f444ba7722d7cca75eb40" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260806 04:46:04.662854 15810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:04.655874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60250 (local address 127.7.113.195:32835)
0806 04:46:04.656041 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:04.656047 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:04.656066 (+ 19us) server_negotiation.cc:407] Connection header received
0806 04:46:04.656184 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:04.656190 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:04.656301 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:04.656389 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:46:04.656958 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.658065 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.660411 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.661037 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.661145 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:04.661697 (+ 552us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:46:04.661859 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:46:04.661951 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:04.662422 (+ 471us) server_negotiation.cc:299] Negotiation successful
0806 04:46:04.662498 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 04:46:04.685246 15597 raft_consensus.cc:1261] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Refusing update from remote peer 8d14b4708c6f444ba7722d7cca75eb40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:46:04.685793 15452 raft_consensus.cc:1261] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Refusing update from remote peer 8d14b4708c6f444ba7722d7cca75eb40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:46:04.685765 15897 consensus_queue.cc:1035] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e5c8ec6fda5406994e414fad41d6d09" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:46:04.686448 15897 consensus_queue.cc:1035] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1270a66ca41646dfa6e652c6eb5af5ef" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:46:04.738426 15286 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:46:04.738675 15286 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:46:04.741865 15286 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9afd98daf7c84f1c99a7dd29d1bcb2a6: Sending DeleteTablet for 3 replicas of tablet 9933b6b67cb44728a72abe1813a6d9ba
I20260806 04:46:04.742609 15432 tablet_service.cc:1514] Processing DeleteTablet for tablet 9933b6b67cb44728a72abe1813a6d9ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:04 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:58848
I20260806 04:46:04.742928 15840 tablet_replica.cc:330] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef: stopping tablet replica
I20260806 04:46:04.742947 15718 tablet_service.cc:1514] Processing DeleteTablet for tablet 9933b6b67cb44728a72abe1813a6d9ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:04 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:60230
I20260806 04:46:04.743137 15840 raft_consensus.cc:2229] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:46:04.743239 15838 tablet_replica.cc:330] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40: stopping tablet replica
I20260806 04:46:04.743312 15576 tablet_service.cc:1514] Processing DeleteTablet for tablet 9933b6b67cb44728a72abe1813a6d9ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:04 UTC) from {username='oryx', principal='oryx/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:53206
I20260806 04:46:04.743343 15840 raft_consensus.cc:2258] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:04.743439 15838 raft_consensus.cc:2229] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:46:04.743577 15839 tablet_replica.cc:330] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09: stopping tablet replica
I20260806 04:46:04.743769 15838 raft_consensus.cc:2258] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:04.743765 15839 raft_consensus.cc:2229] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:46:04.743952 15839 raft_consensus.cc:2258] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:04.744468 15840 ts_tablet_manager.cc:1905] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:46:04.745152 15839 ts_tablet_manager.cc:1905] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:46:04.745639 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 15361
I20260806 04:46:04.748319 15838 ts_tablet_manager.cc:1905] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:46:04.754354 15839 ts_tablet_manager.cc:1918] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:46:04.754550 15839 log.cc:1196] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/9933b6b67cb44728a72abe1813a6d9ba
I20260806 04:46:04.755184 15839 ts_tablet_manager.cc:1939] T 9933b6b67cb44728a72abe1813a6d9ba P 0e5c8ec6fda5406994e414fad41d6d09: Deleting consensus metadata
I20260806 04:46:04.756274 15838 ts_tablet_manager.cc:1918] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:46:04.756342 15272 catalog_manager.cc:4841] TS 0e5c8ec6fda5406994e414fad41d6d09 (127.7.113.194:44151): tablet 9933b6b67cb44728a72abe1813a6d9ba (table test-table [id=a3218b076d254d1fbf2fb4c9cb1cfd01]) successfully deleted
I20260806 04:46:04.760315 15840 ts_tablet_manager.cc:1918] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 04:46:04.760556 15838 log.cc:1196] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/9933b6b67cb44728a72abe1813a6d9ba
I20260806 04:46:04.760767 15840 log.cc:1196] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/9933b6b67cb44728a72abe1813a6d9ba
I20260806 04:46:04.761298 15838 ts_tablet_manager.cc:1939] T 9933b6b67cb44728a72abe1813a6d9ba P 8d14b4708c6f444ba7722d7cca75eb40: Deleting consensus metadata
I20260806 04:46:04.761798 15840 ts_tablet_manager.cc:1939] T 9933b6b67cb44728a72abe1813a6d9ba P 1270a66ca41646dfa6e652c6eb5af5ef: Deleting consensus metadata
I20260806 04:46:04.763288 15270 catalog_manager.cc:4841] TS 8d14b4708c6f444ba7722d7cca75eb40 (127.7.113.195:32835): tablet 9933b6b67cb44728a72abe1813a6d9ba (table test-table [id=a3218b076d254d1fbf2fb4c9cb1cfd01]) successfully deleted
I20260806 04:46:04.764210 15270 catalog_manager.cc:4841] TS 1270a66ca41646dfa6e652c6eb5af5ef (127.7.113.193:34105): tablet 9933b6b67cb44728a72abe1813a6d9ba (table test-table [id=a3218b076d254d1fbf2fb4c9cb1cfd01]) successfully deleted
Aug 06 04:46:04 dist-test-slave-0b58 krb5kdc[15240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.113.193@KRBTEST.COM
I20260806 04:46:04.779112 15885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:04.746815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58862 (local address 127.7.113.193:34105)
0806 04:46:04.747029 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:04.747036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:04.760837 (+ 13801us) server_negotiation.cc:407] Connection header received
0806 04:46:04.761077 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:04.761083 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:04.761156 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:04.761219 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:04.762868 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.763969 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.765801 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.766459 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.766591 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:04.771587 (+ 4996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:04.771602 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:04.771620 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:04.771684 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:04.775432 (+ 3748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:04.776409 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:04.776420 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:04.776423 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:04.776608 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:04.777114 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:04.777120 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:04.777123 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:04.777535 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:04.777850 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:04.778491 (+ 641us) server_negotiation.cc:299] Negotiation successful
0806 04:46:04.778766 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 04:46:04.779687 15498 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:04.878093 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 15361
I20260806 04:46:04.904722 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 15507
Aug 06 04:46:04 dist-test-slave-0b58 krb5kdc[15240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.113.194@KRBTEST.COM
I20260806 04:46:04.921960 15909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:04.905574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53230 (local address 127.7.113.194:44151)
0806 04:46:04.906511 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:04.906515 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:04.906531 (+ 16us) server_negotiation.cc:407] Connection header received
0806 04:46:04.906630 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:04.906635 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:04.906726 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:04.906874 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:04.908175 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.909101 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.910374 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:04.910895 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:04.911040 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:04.915406 (+ 4366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:04.915417 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:04.915431 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:04.915469 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:04.918566 (+ 3097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:04.919273 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:04.919284 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:04.919289 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:04.919425 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:04.919804 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:04.919810 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:04.919813 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:04.920332 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:04.920688 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:04.921048 (+ 360us) server_negotiation.cc:299] Negotiation successful
0806 04:46:04.921431 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":826,"thread_start_us":730,"threads_started":1}
I20260806 04:46:04.922838 15643 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:05.055414 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 15507
I20260806 04:46:05.079228 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 15652
Aug 06 04:46:05 dist-test-slave-0b58 krb5kdc[15240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.113.195@KRBTEST.COM
I20260806 04:46:05.094446 15810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:05.079973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60258 (local address 127.7.113.195:32835)
0806 04:46:05.080183 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:05.080190 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:05.080279 (+ 89us) server_negotiation.cc:407] Connection header received
0806 04:46:05.080517 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:05.080521 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:05.080593 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:05.080700 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:05.082142 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:05.082912 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:05.084206 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:05.084711 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:05.084846 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:05.089104 (+ 4258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:05.089118 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:05.089134 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:05.089165 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:05.091796 (+ 2631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:05.092609 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:05.092616 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:05.092618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:05.092765 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:05.093119 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:05.093122 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:05.093124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:05.093446 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:05.093710 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:05.093917 (+ 207us) server_negotiation.cc:299] Negotiation successful
0806 04:46:05.094076 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 04:46:05.095083 15785 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:05.243058 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 15652
I20260806 04:46:05.270979 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 15253
I20260806 04:46:05.272109 15330 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:05.387010 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 15253
2026-08-06T04:46:05Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6630 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:46:05 dist-test-slave-0b58 krb5kdc[15915](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:46:05 dist-test-slave-0b58 krb5kdc[15915](info): set up 2 sockets
Aug 06 04:46:05 dist-test-slave-0b58 krb5kdc[15915](info): commencing operation
krb5kdc: starting...
W20260806 04:46:06.495455 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:46:06 dist-test-slave-0b58 krb5kdc[15915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:46:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:46:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:46:06.735563 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42183
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:42183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:46:07.057482 15928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:07.057736 15928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:07.057896 15928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:07.065142 15928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:46:07.065230 15928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:07.065325 15928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:07.065425 15928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:46:07.065505 15928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:46:07.075130 15928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:42183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:07.076332 15928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:07.077603 15928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:07.089207 15933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:07.089275 15936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:07.089244 15934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:07.090431 15928 server_base.cc:1034] running on GCE node
I20260806 04:46:07.091192 15928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:07.092573 15928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:07.093776 15928 hybrid_clock.cc:648] HybridClock initialized: now 1785991567093738 us; error 28 us; skew 500 ppm
I20260806 04:46:07.094131 15928 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-06T04:46:07Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1774 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:46:07 dist-test-slave-0b58 krb5kdc[15942](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:46:07 dist-test-slave-0b58 krb5kdc[15942](info): set up 2 sockets
Aug 06 04:46:07 dist-test-slave-0b58 krb5kdc[15942](info): commencing operation
krb5kdc: starting...
W20260806 04:46:08.283435 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.075s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:46:08 dist-test-slave-0b58 krb5kdc[15942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:46:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:46:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:46:08.539867 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42539
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:42539
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:46:08.864351 15956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:08.864665 15956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:08.864856 15956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:08.872120 15956 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:46:08.872217 15956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:08.872334 15956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:08.872440 15956 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:46:08.872524 15956 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:46:08.882148 15956 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:42539
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:08.883443 15956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:08.884730 15956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:08.896559 15962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:08.896606 15963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:08.896648 15965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:08.897461 15956 server_base.cc:1034] running on GCE node
I20260806 04:46:08.898208 15956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:08.899549 15956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:08.900770 15956 hybrid_clock.cc:648] HybridClock initialized: now 1785991568900730 us; error 51 us; skew 500 ppm
I20260806 04:46:08.901116 15956 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:08 dist-test-slave-0b58 krb5kdc[15942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991568, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:08.904560 15956 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:46:08.906030 15956 webserver.cc:460] Webserver started at http://127.7.113.254:43923/ using document root <none> and password file <none>
I20260806 04:46:08.906759 15956 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:08.906922 15956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:08.907233 15956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:08.910629 15956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "b608d49e0d2740d8a319cbcdf53e7ca7"
format_stamp: "Formatted at 2026-08-06 04:46:08 on dist-test-slave-0b58"
server_key: "3fad3716b4d2528bc0b2ab0b058c039d"
server_key_iv: "bd3304829a33bb3560e44391403fae53"
server_key_version: "encryptionkey@0"
I20260806 04:46:08.911438 15956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "b608d49e0d2740d8a319cbcdf53e7ca7"
format_stamp: "Formatted at 2026-08-06 04:46:08 on dist-test-slave-0b58"
server_key: "3fad3716b4d2528bc0b2ab0b058c039d"
server_key_iv: "bd3304829a33bb3560e44391403fae53"
server_key_version: "encryptionkey@0"
I20260806 04:46:08.916666 15956 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 04:46:08.920010 15973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:08.921316 15956 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:46:08.921496 15956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "b608d49e0d2740d8a319cbcdf53e7ca7"
format_stamp: "Formatted at 2026-08-06 04:46:08 on dist-test-slave-0b58"
server_key: "3fad3716b4d2528bc0b2ab0b058c039d"
server_key_iv: "bd3304829a33bb3560e44391403fae53"
server_key_version: "encryptionkey@0"
I20260806 04:46:08.921692 15956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:08.954983 15956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:08.958858 15956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:08.959141 15956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:08.977644 15956 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:42539
I20260806 04:46:08.977677 16025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:42539 every 8 connection(s)
I20260806 04:46:08.978960 15956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:46:08.982538 16026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:08.986779 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 15956
I20260806 04:46:08.987032 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:46:08.987694 7623 external_mini_cluster.cc:1428] Setting key 15871d3c9ef878a1ea9881212fa629b7
I20260806 04:46:08.992965 16026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7: Bootstrap starting.
I20260806 04:46:08.996588 16026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:08.997785 16026 log.cc:824] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7: Log is configured to *not* fsync() on all Append() calls
I20260806 04:46:09.001194 16026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7: No bootstrap required, opened a new log
Aug 06 04:46:08 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:46:09.012154 16030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:08.989614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53738 (local address 127.7.113.254:42539)
0806 04:46:08.990451 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:08.990465 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:08.990506 (+ 41us) server_negotiation.cc:407] Connection header received
0806 04:46:08.992101 (+ 1595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:08.992121 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:08.992539 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:08.992829 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:08.994719 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:08.995959 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:08.997857 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:08.998884 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:08.999086 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:09.003578 (+ 4492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:09.003593 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:09.003611 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:09.003659 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:09.007813 (+ 4154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:09.008496 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:09.008509 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:09.008517 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:09.008717 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:09.009052 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:09.009057 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:09.009061 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:09.009743 (+ 682us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:09.010096 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:09.010400 (+ 304us) server_negotiation.cc:299] Negotiation successful
0806 04:46:09.010825 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":414,"threads_started":1}
I20260806 04:46:09.011996 16026 raft_consensus.cc:348] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42539 } }
I20260806 04:46:09.012532 16026 raft_consensus.cc:374] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:09.012669 16026 raft_consensus.cc:729] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b608d49e0d2740d8a319cbcdf53e7ca7, State: Initialized, Role: FOLLOWER
I20260806 04:46:09.013237 16026 consensus_queue.cc:260] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42539 } }
I20260806 04:46:09.013489 16026 raft_consensus.cc:388] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:46:09.013654 16026 raft_consensus.cc:482] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:46:09.013841 16026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:09.016009 16026 raft_consensus.cc:504] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42539 } }
I20260806 04:46:09.016533 16026 leader_election.cc:302] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b608d49e0d2740d8a319cbcdf53e7ca7; no voters:
I20260806 04:46:09.017098 16026 leader_election.cc:288] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:46:09.017239 16032 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:46:09.017952 16032 raft_consensus.cc:686] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 1 LEADER]: Becoming Leader. State: Replica: b608d49e0d2740d8a319cbcdf53e7ca7, State: Running, Role: LEADER
I20260806 04:46:09.018545 16032 consensus_queue.cc:237] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42539 } }
I20260806 04:46:09.019116 16026 sys_catalog.cc:564] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:46:09.021040 16034 sys_catalog.cc:455] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b608d49e0d2740d8a319cbcdf53e7ca7. Latest consensus state: current_term: 1 leader_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42539 } } }
I20260806 04:46:09.021413 16034 sys_catalog.cc:458] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [sys.catalog]: This master's current role is: LEADER
I20260806 04:46:09.023088 16037 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:46:09.023183 16033 sys_catalog.cc:455] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42539 } } }
I20260806 04:46:09.023581 16033 sys_catalog.cc:458] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [sys.catalog]: This master's current role is: LEADER
I20260806 04:46:09.029903 16037 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:46:09.038273 16037 catalog_manager.cc:1347] Generated new cluster ID: 8db2d31644044b9cab52c7a59ff02583
I20260806 04:46:09.038398 16037 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:46:09.058681 16037 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:46:09.060458 16037 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:46:09.072036 16037 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7: Generated new TSK 0
I20260806 04:46:09.072916 16037 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:46:09.139858 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42539
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:46:09.458760 16056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:09.459002 16056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:09.459092 16056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:09.465950 16056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:09.466040 16056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:09.466156 16056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:46:09.475421 16056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42539
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:09.476569 16056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:09.477795 16056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:09.490734 16064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:09.490777 16062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:09.490813 16061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:09.491958 16056 server_base.cc:1034] running on GCE node
I20260806 04:46:09.492550 16056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:09.493348 16056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:09.494540 16056 hybrid_clock.cc:648] HybridClock initialized: now 1785991569494495 us; error 36 us; skew 500 ppm
I20260806 04:46:09.494840 16056 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:09 dist-test-slave-0b58 krb5kdc[15942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991569, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:09.497804 16056 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:46:09.499220 16056 webserver.cc:460] Webserver started at http://127.7.113.193:43399/ using document root <none> and password file <none>
I20260806 04:46:09.499889 16056 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:09.500029 16056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:09.500411 16056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:09.503118 16056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "c56378ec3c4e4850b499bd3e57d872a3"
format_stamp: "Formatted at 2026-08-06 04:46:09 on dist-test-slave-0b58"
server_key: "b03d02baa630d9e0891dace07e41d99f"
server_key_iv: "ded1a85a51f44b227e338233a9c066ce"
server_key_version: "encryptionkey@0"
I20260806 04:46:09.503860 16056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "c56378ec3c4e4850b499bd3e57d872a3"
format_stamp: "Formatted at 2026-08-06 04:46:09 on dist-test-slave-0b58"
server_key: "b03d02baa630d9e0891dace07e41d99f"
server_key_iv: "ded1a85a51f44b227e338233a9c066ce"
server_key_version: "encryptionkey@0"
I20260806 04:46:09.508816 16056 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 04:46:09.512109 16071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:09.513373 16056 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 04:46:09.513538 16056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "c56378ec3c4e4850b499bd3e57d872a3"
format_stamp: "Formatted at 2026-08-06 04:46:09 on dist-test-slave-0b58"
server_key: "b03d02baa630d9e0891dace07e41d99f"
server_key_iv: "ded1a85a51f44b227e338233a9c066ce"
server_key_version: "encryptionkey@0"
I20260806 04:46:09.513748 16056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:09.539389 16056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:09.543149 16056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:09.543433 16056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:09.544374 16056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:09.545622 16056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:09.545723 16056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:09.545868 16056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:09.545938 16056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:09.579113 16056 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:40419
I20260806 04:46:09.579167 16187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:40419 every 8 connection(s)
I20260806 04:46:09.580430 16056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:46:09.582454 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 16056
I20260806 04:46:09.582675 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:46:09.583561 7623 external_mini_cluster.cc:1428] Setting key 9a1728908c1af3caa33786ca546bf3b5
Aug 06 04:46:09 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991569, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:46:09.602429 16190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:09.583016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:36311 (local address 127.7.113.254:42539)
0806 04:46:09.583472 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:09.583478 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:09.584663 (+ 1185us) server_negotiation.cc:407] Connection header received
0806 04:46:09.587014 (+ 2351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:09.587018 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:09.587080 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:09.587174 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:09.589255 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:09.590000 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:09.592423 (+ 2423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:09.592817 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:09.592920 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:09.596941 (+ 4021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:09.596946 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:09.596950 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:09.596980 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:09.599467 (+ 2487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:09.600154 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:09.600159 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:09.600161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:09.600346 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:09.600778 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:09.600783 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:09.600786 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:09.601039 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:09.601192 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:09.601853 (+ 661us) server_negotiation.cc:299] Negotiation successful
0806 04:46:09.602068 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":219,"threads_started":1}
I20260806 04:46:09.603339 16191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:09.583586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:36311)
0806 04:46:09.584494 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:09.584542 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:09.586740 (+ 2198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:09.587441 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:09.587454 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:09.588291 (+ 837us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:09.589068 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:09.589096 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:09.590168 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:09.590176 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:09.592239 (+ 2063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:09.592293 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:09.593038 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:09.593047 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:09.593369 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:09.594070 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:09.594103 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:09.596710 (+ 2607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:09.599599 (+ 2889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:09.599608 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:09.599622 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:09.600025 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:09.600457 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:09.600462 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:09.600466 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:09.600657 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:09.601166 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:09.601174 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:09.601478 (+ 304us) client_negotiation.cc:769] Sending connection context
0806 04:46:09.601733 (+ 255us) client_negotiation.cc:240] Negotiation successful
0806 04:46:09.602220 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":322,"threads_started":1}
I20260806 04:46:09.604918 16188 heartbeater.cc:347] Connected to a master server at 127.7.113.254:42539
I20260806 04:46:09.605232 16188 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:09.605937 16188 heartbeater.cc:511] Master 127.7.113.254:42539 requested a full tablet report, sending...
I20260806 04:46:09.608040 15991 ts_manager.cc:194] Registered new tserver with Master: c56378ec3c4e4850b499bd3e57d872a3 (127.7.113.193:40419)
I20260806 04:46:09.609524 15991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:36311
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:46:09.643239 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42539
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:46:09.963035 16194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:09.963270 16194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:09.963362 16194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:09.970178 16194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:09.970269 16194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:09.970371 16194 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:46:09.979417 16194 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42539
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:09.980587 16194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:09.981832 16194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:09.995169 16199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:09.995147 16202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:09.995090 16200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:09.995689 16194 server_base.cc:1034] running on GCE node
I20260806 04:46:09.996356 16194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:09.997210 16194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:09.998437 16194 hybrid_clock.cc:648] HybridClock initialized: now 1785991569998400 us; error 51 us; skew 500 ppm
I20260806 04:46:09.998736 16194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:09 dist-test-slave-0b58 krb5kdc[15942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991569, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:10.001863 16194 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:46:10.003364 16194 webserver.cc:460] Webserver started at http://127.7.113.194:42661/ using document root <none> and password file <none>
I20260806 04:46:10.004024 16194 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:10.004172 16194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:10.004511 16194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:10.007241 16194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "0c1476c987324d389c998e9f1d4c0699"
format_stamp: "Formatted at 2026-08-06 04:46:10 on dist-test-slave-0b58"
server_key: "079bb70644347b37d61809d154550e7c"
server_key_iv: "a35f64ee2fd5d751e26e817c1cc8ca4c"
server_key_version: "encryptionkey@0"
I20260806 04:46:10.008014 16194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "0c1476c987324d389c998e9f1d4c0699"
format_stamp: "Formatted at 2026-08-06 04:46:10 on dist-test-slave-0b58"
server_key: "079bb70644347b37d61809d154550e7c"
server_key_iv: "a35f64ee2fd5d751e26e817c1cc8ca4c"
server_key_version: "encryptionkey@0"
I20260806 04:46:10.013023 16194 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260806 04:46:10.016389 16209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:10.017722 16194 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:46:10.017915 16194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "0c1476c987324d389c998e9f1d4c0699"
format_stamp: "Formatted at 2026-08-06 04:46:10 on dist-test-slave-0b58"
server_key: "079bb70644347b37d61809d154550e7c"
server_key_iv: "a35f64ee2fd5d751e26e817c1cc8ca4c"
server_key_version: "encryptionkey@0"
I20260806 04:46:10.018103 16194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:10.034255 16194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:10.038307 16194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:10.038586 16194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:10.039440 16194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:10.040714 16194 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:10.040815 16194 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:10.040969 16194 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:10.041041 16194 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:10.074090 16194 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:38579
I20260806 04:46:10.074244 16321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:38579 every 8 connection(s)
I20260806 04:46:10.075306 16194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:46:10.075590 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 16194
I20260806 04:46:10.075783 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:46:10.076391 7623 external_mini_cluster.cc:1428] Setting key 2db19d2c6e1e511dfc3223fb7e7f2456
Aug 06 04:46:10 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991569, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:46:10.096611 16190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:10.077939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:43307 (local address 127.7.113.254:42539)
0806 04:46:10.078101 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:10.078105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:10.079412 (+ 1307us) server_negotiation.cc:407] Connection header received
0806 04:46:10.081205 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:10.081210 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:10.081299 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:10.081404 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:10.082745 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:10.083458 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:10.085006 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:10.085414 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:10.085563 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:10.089705 (+ 4142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:10.089713 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:10.089719 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:10.089760 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:10.093376 (+ 3616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:10.094075 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:10.094083 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:10.094089 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:10.094266 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:10.094671 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:10.094678 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:10.094684 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:10.095048 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:10.095196 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:10.095840 (+ 644us) server_negotiation.cc:299] Negotiation successful
0806 04:46:10.096099 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 04:46:10.097405 16324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:10.078521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:43307)
0806 04:46:10.079267 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:10.079311 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:10.080942 (+ 1631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:10.081620 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:10.081628 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:10.082092 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:10.082592 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:10.082608 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:10.083615 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:10.083619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:10.084868 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:10.084879 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:10.085661 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:10.085669 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:10.085997 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:10.086761 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:10.086794 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:10.089464 (+ 2670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:10.093511 (+ 4047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:10.093518 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:10.093528 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:10.093945 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:10.094388 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:10.094391 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:10.094393 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:10.094557 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:10.095169 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:10.095174 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:10.095479 (+ 305us) client_negotiation.cc:769] Sending connection context
0806 04:46:10.095682 (+ 203us) client_negotiation.cc:240] Negotiation successful
0806 04:46:10.096016 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":323,"threads_started":1}
I20260806 04:46:10.098822 16322 heartbeater.cc:347] Connected to a master server at 127.7.113.254:42539
I20260806 04:46:10.099129 16322 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:10.099831 16322 heartbeater.cc:511] Master 127.7.113.254:42539 requested a full tablet report, sending...
I20260806 04:46:10.101353 15991 ts_manager.cc:194] Registered new tserver with Master: 0c1476c987324d389c998e9f1d4c0699 (127.7.113.194:38579)
I20260806 04:46:10.102154 15991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:43307
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:46:10.137832 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42539
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:46:10.462590 16327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:10.462834 16327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:10.462924 16327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:10.469974 16327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:10.470065 16327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:10.470166 16327 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:46:10.479637 16327 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42539
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:10.480827 16327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:10.482141 16327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:10.496596 16332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:10.496627 16335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:10.496552 16333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:10.497426 16327 server_base.cc:1034] running on GCE node
I20260806 04:46:10.497996 16327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:10.498839 16327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:10.500036 16327 hybrid_clock.cc:648] HybridClock initialized: now 1785991570499996 us; error 28 us; skew 500 ppm
I20260806 04:46:10.500437 16327 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:10 dist-test-slave-0b58 krb5kdc[15942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991570, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:10.503458 16327 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:46:10.505081 16327 webserver.cc:460] Webserver started at http://127.7.113.195:45439/ using document root <none> and password file <none>
I20260806 04:46:10.505764 16327 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:10.505925 16327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:10.506248 16327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:10.509225 16327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "b00ea94d64584ac2ad79e333a72bd145"
format_stamp: "Formatted at 2026-08-06 04:46:10 on dist-test-slave-0b58"
server_key: "1d4fd1354cb80f68e41d5098508d4538"
server_key_iv: "c2710ef969803ac56bdbb0538ac0388d"
server_key_version: "encryptionkey@0"
I20260806 04:46:10.510007 16327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "b00ea94d64584ac2ad79e333a72bd145"
format_stamp: "Formatted at 2026-08-06 04:46:10 on dist-test-slave-0b58"
server_key: "1d4fd1354cb80f68e41d5098508d4538"
server_key_iv: "c2710ef969803ac56bdbb0538ac0388d"
server_key_version: "encryptionkey@0"
I20260806 04:46:10.515049 16327 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 04:46:10.518729 16343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:10.520087 16327 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260806 04:46:10.520243 16327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "b00ea94d64584ac2ad79e333a72bd145"
format_stamp: "Formatted at 2026-08-06 04:46:10 on dist-test-slave-0b58"
server_key: "1d4fd1354cb80f68e41d5098508d4538"
server_key_iv: "c2710ef969803ac56bdbb0538ac0388d"
server_key_version: "encryptionkey@0"
I20260806 04:46:10.520533 16327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:10.539656 16327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:10.543592 16327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:10.543869 16327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:10.544783 16327 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:10.546042 16327 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:10.546193 16327 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:10.546375 16327 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:10.546448 16327 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:10.585269 16327 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:35409
I20260806 04:46:10.585306 16457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:35409 every 8 connection(s)
I20260806 04:46:10.586546 16327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:46:10.593335 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 16327
I20260806 04:46:10.593542 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:46:10.594038 7623 external_mini_cluster.cc:1428] Setting key 3765fb1f66922542ce377ab27aa76f12
Aug 06 04:46:10 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991570, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:46:10.605309 16190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:10.589017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:54033 (local address 127.7.113.254:42539)
0806 04:46:10.589220 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:10.589226 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:10.590455 (+ 1229us) server_negotiation.cc:407] Connection header received
0806 04:46:10.592160 (+ 1705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:10.592164 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:10.592240 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:10.592371 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:10.593837 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:10.594837 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:10.596600 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:10.597158 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:10.597252 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:10.600494 (+ 3242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:10.600498 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:10.600501 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:10.600533 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:10.602740 (+ 2207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:10.603326 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:10.603330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:10.603332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:10.603468 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:10.603856 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:10.603859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:10.603861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:10.604167 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:10.604357 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:10.604910 (+ 553us) server_negotiation.cc:299] Negotiation successful
0806 04:46:10.605072 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 04:46:10.606196 16460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:10.589556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:54033)
0806 04:46:10.590294 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:10.590343 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:10.591935 (+ 1592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:10.592539 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:10.592547 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:10.593036 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:10.593681 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:10.593701 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:10.594999 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:10.595006 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:10.596474 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:10.596486 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:10.597349 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:10.597353 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:10.597530 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:10.598212 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:10.598238 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:10.600222 (+ 1984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:10.602852 (+ 2630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:10.602858 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:10.602868 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:10.603236 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:10.603588 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:10.603591 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:10.603593 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:10.603760 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:10.604336 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:10.604342 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:10.604611 (+ 269us) client_negotiation.cc:769] Sending connection context
0806 04:46:10.604821 (+ 210us) client_negotiation.cc:240] Negotiation successful
0806 04:46:10.605152 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":283,"threads_started":1}
I20260806 04:46:10.607609 16458 heartbeater.cc:347] Connected to a master server at 127.7.113.254:42539
I20260806 04:46:10.607957 16458 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:10.608839 16458 heartbeater.cc:511] Master 127.7.113.254:42539 requested a full tablet report, sending...
I20260806 04:46:10.610167 15991 ts_manager.cc:194] Registered new tserver with Master: b00ea94d64584ac2ad79e333a72bd145 (127.7.113.195:35409)
I20260806 04:46:10.610968 15991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:54033
I20260806 04:46:10.612190 16188 heartbeater.cc:503] Master 127.7.113.254:42539 was elected leader, sending a full tablet report...
I20260806 04:46:10.621059 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.193.keytab.
Entry for principal oryx/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.193.keytab.
WARNING: no policy specified for oryx/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.194.keytab.
Entry for principal oryx/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.194.keytab.
WARNING: no policy specified for oryx/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.195.keytab.
Entry for principal oryx/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.195.keytab.
I20260806 04:46:10.770825 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 16056
Aug 06 04:46:10 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:46:10.786547 16468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:10.772009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53922 (local address 127.7.113.193:40419)
0806 04:46:10.772708 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:10.772715 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:10.772742 (+ 27us) server_negotiation.cc:407] Connection header received
0806 04:46:10.772806 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:10.772814 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:10.773036 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:10.773176 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:10.774476 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:10.775483 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:10.776715 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:10.777255 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:10.777361 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:10.781268 (+ 3907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:10.781279 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:10.781301 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:10.781337 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:10.784209 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:10.784852 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:10.784859 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:10.784861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:10.784982 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:10.785307 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:10.785310 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:10.785312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:10.785630 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:10.785854 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:10.786058 (+ 204us) server_negotiation.cc:299] Negotiation successful
0806 04:46:10.786261 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":394,"threads_started":1}
I20260806 04:46:10.787853 16183 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:10.869906 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 16056
I20260806 04:46:10.888477 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 16194
Aug 06 04:46:10 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:46:10.904153 16470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:10.889377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37634 (local address 127.7.113.194:38579)
0806 04:46:10.889927 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:10.889934 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:10.889957 (+ 23us) server_negotiation.cc:407] Connection header received
0806 04:46:10.890014 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:10.890020 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:10.890219 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:10.890337 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:10.891515 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:10.892591 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:10.893949 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:10.894494 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:10.894614 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:10.898915 (+ 4301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:10.898926 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:10.898940 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:10.898972 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:10.901824 (+ 2852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:10.902413 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:10.902420 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:10.902422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:10.902553 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:10.902899 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:10.902903 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:10.902904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:10.903212 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:10.903434 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:10.903673 (+ 239us) server_negotiation.cc:299] Negotiation successful
0806 04:46:10.903867 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":297,"threads_started":1}
I20260806 04:46:10.905473 16317 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:10.988044 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 16194
I20260806 04:46:11.006160 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 16327
Aug 06 04:46:11 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:46:11.023433 16472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:11.007167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36570 (local address 127.7.113.195:35409)
0806 04:46:11.007855 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:11.007862 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:11.007891 (+ 29us) server_negotiation.cc:407] Connection header received
0806 04:46:11.007951 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:11.007957 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:11.008197 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:11.008406 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:11.010081 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:11.011058 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:11.012366 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:11.012937 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:11.013080 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:11.017569 (+ 4489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:11.017579 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:11.017593 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:11.017629 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:11.020663 (+ 3034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:11.021306 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:11.021315 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:11.021319 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:11.021462 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:11.021833 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:11.021839 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:11.021842 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:11.022193 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:11.022503 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:11.022810 (+ 307us) server_negotiation.cc:299] Negotiation successful
0806 04:46:11.023078 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":351,"threads_started":1}
I20260806 04:46:11.024835 16453 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:11.105976 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 16327
I20260806 04:46:11.123660 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 15956
I20260806 04:46:11.124861 16021 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:11.227157 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 15956
I20260806 04:46:11.249634 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42539
--webserver_interface=127.7.113.254
--webserver_port=43923
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:42539
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:46:11.570827 16475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:11.571080 16475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:11.571256 16475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:11.578334 16475 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:46:11.578446 16475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:11.578517 16475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:11.578603 16475 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:46:11.578697 16475 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:46:11.587981 16475 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:42539
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=43923
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:11.589196 16475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:11.590405 16475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:11.601863 16481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:11.601922 16480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:11.601946 16483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:11.602881 16475 server_base.cc:1034] running on GCE node
I20260806 04:46:11.603653 16475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:11.604984 16475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:11.606251 16475 hybrid_clock.cc:648] HybridClock initialized: now 1785991571606203 us; error 44 us; skew 500 ppm
I20260806 04:46:11.606576 16475 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:11 dist-test-slave-0b58 krb5kdc[15942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991571, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:11.609596 16475 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:46:11.611014 16475 webserver.cc:460] Webserver started at http://127.7.113.254:43923/ using document root <none> and password file <none>
I20260806 04:46:11.611661 16475 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:11.611814 16475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:11.617084 16475 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260806 04:46:11.619848 16490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:11.621248 16475 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:46:11.621429 16475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "b608d49e0d2740d8a319cbcdf53e7ca7"
format_stamp: "Formatted at 2026-08-06 04:46:08 on dist-test-slave-0b58"
server_key: "3fad3716b4d2528bc0b2ab0b058c039d"
server_key_iv: "bd3304829a33bb3560e44391403fae53"
server_key_version: "encryptionkey@0"
I20260806 04:46:11.622409 16475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:11.638254 16475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:11.641953 16475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:11.642215 16475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:11.659569 16475 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:42539
I20260806 04:46:11.659602 16542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:42539 every 8 connection(s)
I20260806 04:46:11.661015 16475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:46:11.662254 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 16475
I20260806 04:46:11.663013 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:40419
--local_ip_for_outbound_sockets=127.7.113.193
--tserver_master_addrs=127.7.113.254:42539
--webserver_port=43399
--webserver_interface=127.7.113.193
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.113.193
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:46:11.667799 16543 sys_catalog.cc:263] Verifying existing consensus state
I20260806 04:46:11.670964 16543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7: Bootstrap starting.
I20260806 04:46:11.696921 16543 log.cc:824] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7: Log is configured to *not* fsync() on all Append() calls
I20260806 04:46:11.707392 16543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 04:46:11.707993 16543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7: Bootstrap complete.
I20260806 04:46:11.720882 16543 raft_consensus.cc:348] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42539 } }
I20260806 04:46:11.721695 16543 raft_consensus.cc:729] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b608d49e0d2740d8a319cbcdf53e7ca7, State: Initialized, Role: FOLLOWER
I20260806 04:46:11.722342 16543 consensus_queue.cc:260] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42539 } }
I20260806 04:46:11.722584 16543 raft_consensus.cc:388] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:46:11.722713 16543 raft_consensus.cc:482] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:46:11.722909 16543 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 1 FOLLOWER]: Advancing to term 2
I20260806 04:46:11.726804 16543 raft_consensus.cc:504] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42539 } }
I20260806 04:46:11.727290 16543 leader_election.cc:302] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b608d49e0d2740d8a319cbcdf53e7ca7; no voters:
I20260806 04:46:11.727905 16543 leader_election.cc:288] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 04:46:11.728102 16547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 04:46:11.729370 16547 raft_consensus.cc:686] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [term 2 LEADER]: Becoming Leader. State: Replica: b608d49e0d2740d8a319cbcdf53e7ca7, State: Running, Role: LEADER
I20260806 04:46:11.730043 16543 sys_catalog.cc:564] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:46:11.729974 16547 consensus_queue.cc:237] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42539 } }
I20260806 04:46:11.736568 16548 sys_catalog.cc:455] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42539 } } }
I20260806 04:46:11.736946 16548 sys_catalog.cc:458] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [sys.catalog]: This master's current role is: LEADER
I20260806 04:46:11.737633 16549 sys_catalog.cc:455] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b608d49e0d2740d8a319cbcdf53e7ca7. Latest consensus state: current_term: 2 leader_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b608d49e0d2740d8a319cbcdf53e7ca7" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42539 } } }
I20260806 04:46:11.737974 16549 sys_catalog.cc:458] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7 [sys.catalog]: This master's current role is: LEADER
I20260806 04:46:11.746234 16563 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:46:11.751415 16563 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:46:11.752812 16563 catalog_manager.cc:1259] Loaded cluster ID: 8db2d31644044b9cab52c7a59ff02583
I20260806 04:46:11.752909 16563 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:46:11.757418 16563 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:46:11.758800 16563 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b608d49e0d2740d8a319cbcdf53e7ca7: Loaded TSK: 0
I20260806 04:46:11.760241 16563 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 04:46:12.018977 16545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:12.019313 16545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:12.019469 16545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:12.026872 16545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:12.027011 16545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:12.027184 16545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:46:12.037232 16545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.193.keytab
--principal=oryx/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:40419
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=43399
--tserver_master_addrs=127.7.113.254:42539
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:12.038640 16545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:12.040011 16545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:12.054394 16570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:12.054507 16569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:12.054987 16572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:12.055792 16545 server_base.cc:1034] running on GCE node
I20260806 04:46:12.056457 16545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:12.057490 16545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:12.058728 16545 hybrid_clock.cc:648] HybridClock initialized: now 1785991572058663 us; error 51 us; skew 500 ppm
I20260806 04:46:12.059073 16545 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:12 dist-test-slave-0b58 krb5kdc[15942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991572, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:12.062995 16545 init.cc:377] Logged in from keytab as oryx/127.7.113.193@KRBTEST.COM (short username oryx)
I20260806 04:46:12.064682 16545 webserver.cc:460] Webserver started at http://127.7.113.193:43399/ using document root <none> and password file <none>
I20260806 04:46:12.065557 16545 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:12.065703 16545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:12.072656 16545 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 04:46:12.075757 16579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:12.077395 16545 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:46:12.077579 16545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "c56378ec3c4e4850b499bd3e57d872a3"
format_stamp: "Formatted at 2026-08-06 04:46:09 on dist-test-slave-0b58"
server_key: "b03d02baa630d9e0891dace07e41d99f"
server_key_iv: "ded1a85a51f44b227e338233a9c066ce"
server_key_version: "encryptionkey@0"
I20260806 04:46:12.078970 16545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:12.107573 16545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:12.111640 16545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:12.111884 16545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:12.112926 16545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:12.114181 16545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:12.114267 16545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:12.114348 16545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:12.114454 16545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:12.147037 16545 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:40419
I20260806 04:46:12.147121 16693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:40419 every 8 connection(s)
I20260806 04:46:12.148492 16545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:46:12.155521 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 16545
I20260806 04:46:12.156136 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:38579
--local_ip_for_outbound_sockets=127.7.113.194
--tserver_master_addrs=127.7.113.254:42539
--webserver_port=42661
--webserver_interface=127.7.113.194
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.113.194
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 04:46:12 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:12 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
W20260806 04:46:12.490808 16698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:12.491106 16698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:12.491266 16698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:12.498317 16698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:12.498486 16698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:12.498652 16698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:46:12.508208 16698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.194.keytab
--principal=oryx/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:38579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=42661
--tserver_master_addrs=127.7.113.254:42539
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:12.509471 16698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:12.510731 16698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:12.528331 16708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:12.528515 16706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:12.529269 16705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:12.529372 16698 server_base.cc:1034] running on GCE node
I20260806 04:46:12.530396 16698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:12.531864 16698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:12.533147 16698 hybrid_clock.cc:648] HybridClock initialized: now 1785991572533049 us; error 63 us; skew 500 ppm
I20260806 04:46:12.533689 16698 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:12 dist-test-slave-0b58 krb5kdc[15942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991572, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:12.538347 16698 init.cc:377] Logged in from keytab as oryx/127.7.113.194@KRBTEST.COM (short username oryx)
I20260806 04:46:12.539851 16698 webserver.cc:460] Webserver started at http://127.7.113.194:42661/ using document root <none> and password file <none>
I20260806 04:46:12.540566 16698 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:12.540714 16698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:12.546221 16698 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260806 04:46:12.549249 16715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:12.550747 16698 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:46:12.550901 16698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "0c1476c987324d389c998e9f1d4c0699"
format_stamp: "Formatted at 2026-08-06 04:46:10 on dist-test-slave-0b58"
server_key: "079bb70644347b37d61809d154550e7c"
server_key_iv: "a35f64ee2fd5d751e26e817c1cc8ca4c"
server_key_version: "encryptionkey@0"
I20260806 04:46:12.551795 16698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:12.580494 16698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:12.585018 16698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:12.585265 16698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:12.586301 16698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:12.587643 16698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:12.587765 16698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:12.587890 16698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:12.587973 16698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:12.626341 16698 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:38579
I20260806 04:46:12.626425 16829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:38579 every 8 connection(s)
I20260806 04:46:12.627873 16698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:46:12.637428 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 16698
I20260806 04:46:12.638499 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:35409
--local_ip_for_outbound_sockets=127.7.113.195
--tserver_master_addrs=127.7.113.254:42539
--webserver_port=45439
--webserver_interface=127.7.113.195
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.113.195
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 04:46:12 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:12 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
W20260806 04:46:13.311549 16835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:13.311810 16835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:13.311972 16835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:13.319758 16835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:13.319859 16835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:13.320075 16835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:46:13.330497 16835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/krb5kdc/oryx_127.7.113.195.keytab
--principal=oryx/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:35409
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=45439
--tserver_master_addrs=127.7.113.254:42539
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:13.331820 16835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:13.333271 16835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:13.347200 16841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:13.347208 16840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:13.347424 16843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:13.348487 16835 server_base.cc:1034] running on GCE node
I20260806 04:46:13.349520 16835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:13.350984 16835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:13.352339 16835 hybrid_clock.cc:648] HybridClock initialized: now 1785991573352230 us; error 75 us; skew 500 ppm
I20260806 04:46:13.352869 16835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:13 dist-test-slave-0b58 krb5kdc[15942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991573, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:13.357774 16835 init.cc:377] Logged in from keytab as oryx/127.7.113.195@KRBTEST.COM (short username oryx)
I20260806 04:46:13.359508 16835 webserver.cc:460] Webserver started at http://127.7.113.195:45439/ using document root <none> and password file <none>
I20260806 04:46:13.360159 16835 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:13.360363 16835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:13.365603 16835 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260806 04:46:13.368198 16850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:13.369683 16835 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 04:46:13.369854 16835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "b00ea94d64584ac2ad79e333a72bd145"
format_stamp: "Formatted at 2026-08-06 04:46:10 on dist-test-slave-0b58"
server_key: "1d4fd1354cb80f68e41d5098508d4538"
server_key_iv: "c2710ef969803ac56bdbb0538ac0388d"
server_key_version: "encryptionkey@0"
I20260806 04:46:13.370764 16835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:13.395437 16835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:13.399505 16835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:13.399808 16835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:13.400941 16835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:13.402300 16835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:13.402422 16835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:13.402552 16835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:13.402642 16835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:13.450680 16835 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:35409
I20260806 04:46:13.450737 16963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:35409 every 8 connection(s)
I20260806 04:46:13.452291 16835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:46:13.461040 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 16835
Aug 06 04:46:13 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:13 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:13.500000 16969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:13.468605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38304 (local address 127.7.113.254:42539)
0806 04:46:13.474395 (+ 5790us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:13.474402 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:13.474949 (+ 547us) server_negotiation.cc:407] Connection header received
0806 04:46:13.475309 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:13.475314 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:13.475398 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:13.475495 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:13.478656 (+ 3161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.479894 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.481734 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.482686 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.482800 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:13.487656 (+ 4856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:13.487670 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:13.487692 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:13.487740 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:13.492047 (+ 4307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:13.492970 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:13.492981 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:13.492989 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:13.494401 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:13.494896 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:13.494904 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:13.494910 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:13.495573 (+ 663us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:13.495918 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:13.497743 (+ 1825us) server_negotiation.cc:299] Negotiation successful
0806 04:46:13.498454 (+ 711us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5650,"thread_start_us":5541,"threads_started":1}
W20260806 04:46:13.544071 16697 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.382s user 0.000s sys 0.017s
W20260806 04:46:13.546253 16696 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:12.151239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:54259 (local address 127.7.113.254:42539)
0806 04:46:12.151890 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:12.151900 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:12.152212 (+ 312us) server_negotiation.cc:407] Connection header received
0806 04:46:12.154220 (+ 2008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:12.154231 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:12.154541 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:12.154814 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:12.156213 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:12.158236 (+ 2023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:12.159779 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:12.160837 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:12.161019 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:13.545757 (+1384738us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:54259: BlockingRecv error: recv got EOF from 127.7.113.193:54259 (error 108)
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":258,"threads_started":1}
I20260806 04:46:13.547021 16697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:12.151259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:54259)
0806 04:46:12.152048 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:12.152092 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:12.153770 (+ 1678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:12.154958 (+ 1188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:12.154966 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:12.155438 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:12.156002 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:12.156018 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:12.158404 (+ 2386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:12.158408 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:12.159611 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:12.159623 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:12.161213 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:12.161219 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:12.161411 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:12.162059 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:12.162080 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:13.545380 (+1383300us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":349,"threads_started":1}
W20260806 04:46:13.548419 16694 heartbeater.cc:644] Failed to heartbeat to 127.7.113.254:42539 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.113.254:42539: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Aug 06 04:46:13 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:13 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:13.565884 16697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:13.549397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:57235)
0806 04:46:13.549767 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:13.549794 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:13.549946 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:13.550445 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:13.550452 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:13.551121 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:13.551448 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:13.551464 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.553528 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.553537 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:13.555881 (+ 2344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:13.555903 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.557676 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.557685 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:13.557971 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:13.558972 (+ 1001us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:13.559007 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:13.565413 (+ 6406us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183}
W20260806 04:46:13.566149 16696 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:13.549615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:57235 (local address 127.7.113.254:42539)
0806 04:46:13.549845 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:13.549852 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:13.549880 (+ 28us) server_negotiation.cc:407] Connection header received
0806 04:46:13.550133 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:13.550141 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:13.550248 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:13.550398 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:13.551641 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.553317 (+ 1676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.556130 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.557128 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.557261 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:13.565770 (+ 8509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:57235: BlockingRecv error: recv got EOF from 127.7.113.193:57235 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 06 04:46:13 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:13 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:13.591918 16697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:13.567195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:33089)
0806 04:46:13.572577 (+ 5382us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:13.572605 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:13.572874 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:13.573581 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:13.573589 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:13.574193 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:13.574656 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:13.574675 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.576878 (+ 2203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.576886 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:13.579290 (+ 2404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:13.579311 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.583690 (+ 4379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.583700 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:13.583999 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:13.584976 (+ 977us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:13.585012 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:13.591417 (+ 6405us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":5227,"thread_start_us":20281,"threads_started":1}
W20260806 04:46:13.592124 16696 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:13.567248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:33089 (local address 127.7.113.254:42539)
0806 04:46:13.567443 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:13.567453 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:13.572710 (+ 5257us) server_negotiation.cc:407] Connection header received
0806 04:46:13.573057 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:13.573065 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:13.573186 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:13.573280 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:13.574892 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.576512 (+ 1620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.579530 (+ 3018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.583171 (+ 3641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.583310 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:13.591739 (+ 8429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:33089: BlockingRecv error: recv got EOF from 127.7.113.193:33089 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260806 04:46:13.592955 16694 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 04:46:13.777715 16833 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.137s user 0.001s sys 0.013s
W20260806 04:46:13.779073 16832 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:12.630639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:60521 (local address 127.7.113.254:42539)
0806 04:46:12.631299 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:12.631310 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:12.632120 (+ 810us) server_negotiation.cc:407] Connection header received
0806 04:46:12.634141 (+ 2021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:12.634150 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:12.634264 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:12.634442 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:12.635911 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:12.637059 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:12.639300 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:12.639723 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:12.639871 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:13.778730 (+1138859us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:60521: BlockingRecv error: recv got EOF from 127.7.113.194:60521 (error 108)
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":312,"threads_started":1}
I20260806 04:46:13.779632 16833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:12.631154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:60521)
0806 04:46:12.631962 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:12.632004 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:12.633889 (+ 1885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:12.634599 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:12.634606 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:12.635070 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:12.635710 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:12.635734 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:12.637264 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:12.637270 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:12.639139 (+ 1869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:12.639152 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:12.639954 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:12.639964 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:12.640208 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:12.641017 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:12.641037 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:13.778525 (+1137488us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":332,"threads_started":1}
W20260806 04:46:13.780620 16830 heartbeater.cc:644] Failed to heartbeat to 127.7.113.254:42539 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.113.254:42539: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Aug 06 04:46:13 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:13 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:13.792105 16833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:13.781407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:50019)
0806 04:46:13.781618 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:13.781632 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:13.781763 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:13.782049 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:13.782054 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:13.782524 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:13.782699 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:13.782708 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.784943 (+ 2235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.784947 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:13.785872 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:13.785882 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.787189 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.787194 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:13.787317 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:13.788067 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:13.788083 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:13.791907 (+ 3824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":89}
W20260806 04:46:13.792869 16832 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:13.781408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:50019 (local address 127.7.113.254:42539)
0806 04:46:13.781560 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:13.781565 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:13.781695 (+ 130us) server_negotiation.cc:407] Connection header received
0806 04:46:13.781875 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:13.781879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:13.781934 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:13.782024 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:13.782902 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.784776 (+ 1874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.786015 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.787005 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.787184 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:13.792508 (+ 5324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:50019: BlockingRecv error: recv got EOF from 127.7.113.194:50019 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 06 04:46:13 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:13 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
W20260806 04:46:13.804924 16696 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:13.793019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:39929 (local address 127.7.113.254:42539)
0806 04:46:13.793185 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:13.793189 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:13.793489 (+ 300us) server_negotiation.cc:407] Connection header received
0806 04:46:13.793676 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:13.793679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:13.793730 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:13.793798 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:13.794972 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.795620 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.798179 (+ 2559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.798594 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.798692 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:13.804766 (+ 6074us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:39929: BlockingRecv error: recv got EOF from 127.7.113.194:39929 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 04:46:13.805027 16833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:13.792846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:39929)
0806 04:46:13.793379 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:13.793406 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:13.793554 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:13.793877 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:13.793885 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:13.794509 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:13.794784 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:13.794799 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.795775 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.795783 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:13.798012 (+ 2229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:13.798033 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.798772 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.798781 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:13.799100 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:13.799806 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:13.799837 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:13.804634 (+ 4797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":363}
W20260806 04:46:13.805467 16830 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 04:46:14.586946 16967 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.104s user 0.001s sys 0.017s
W20260806 04:46:14.588044 16966 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:13.456721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:43531 (local address 127.7.113.254:42539)
0806 04:46:13.468661 (+ 11940us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:13.468668 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:13.472587 (+ 3919us) server_negotiation.cc:407] Connection header received
0806 04:46:13.472662 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:13.472667 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:13.472779 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:13.472906 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:13.476637 (+ 3731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.477938 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.480374 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.480974 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.481060 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:14.587837 (+1106777us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:43531: BlockingRecv error: recv got EOF from 127.7.113.195:43531 (error 108)
Metrics: {"server-negotiator.queue_time_us":11800,"thread_start_us":11639,"threads_started":1}
I20260806 04:46:14.588666 16967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:13.456647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:43531)
0806 04:46:13.469397 (+ 12750us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:13.469471 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:13.472197 (+ 2726us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:13.473669 (+ 1472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:13.473688 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:13.475810 (+ 2122us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:13.476460 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:13.476479 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.478132 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.478137 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:13.480187 (+ 2050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:13.480201 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:13.481426 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:13.481433 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:13.481716 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:13.482458 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:13.482486 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:14.587682 (+1105196us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":12332,"thread_start_us":12052,"threads_started":1}
W20260806 04:46:14.589571 16964 heartbeater.cc:644] Failed to heartbeat to 127.7.113.254:42539 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.113.254:42539: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Aug 06 04:46:14 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:14 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:14.600703 16967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:14.590152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:36267)
0806 04:46:14.590367 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:14.590387 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:14.590509 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:14.590812 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:14.590816 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:14.591190 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:14.591413 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:14.591425 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.592766 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.592771 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:14.594536 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:14.594556 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.595918 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.595922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:14.596042 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:14.596721 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:14.596743 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:14.600432 (+ 3689us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":63}
W20260806 04:46:14.600925 16966 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:14.590211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:36267 (local address 127.7.113.254:42539)
0806 04:46:14.590377 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:14.590385 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:14.590438 (+ 53us) server_negotiation.cc:407] Connection header received
0806 04:46:14.590627 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:14.590631 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:14.590689 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:14.590794 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:14.591550 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.592626 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.594716 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.595738 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.595901 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:14.600665 (+ 4764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:36267: BlockingRecv error: recv got EOF from 127.7.113.195:36267 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 06 04:46:14 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:14 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:14.606101 16972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:14.593481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:46243)
0806 04:46:14.595277 (+ 1796us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:14.595308 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:14.595400 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:14.596716 (+ 1316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:14.596720 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:14.597281 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:14.597480 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:14.597493 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.598528 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.598532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:14.599548 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:14.599562 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.600520 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.600526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:14.600711 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:14.601347 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:14.601372 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:14.605891 (+ 4519us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1687,"thread_start_us":1593,"threads_started":1}
W20260806 04:46:14.606514 16973 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:14.593542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:46243 (local address 127.7.113.254:42539)
0806 04:46:14.596373 (+ 2831us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:14.596378 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:14.596396 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:46:14.596449 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:14.596456 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:14.596532 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:14.596632 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:14.597631 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.598320 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.599684 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.600334 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.600452 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:14.606172 (+ 5720us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:46243: BlockingRecv error: recv got EOF from 127.7.113.193:46243 (error 108)
Metrics: {"server-negotiator.queue_time_us":2672,"thread_start_us":2495,"threads_started":1}
Aug 06 04:46:14 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:14 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:14.610682 16967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:14.601302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:40379)
0806 04:46:14.601514 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:14.601532 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:14.601622 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:14.602129 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:14.602137 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:14.602579 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:14.602763 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:14.602778 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.604080 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.604086 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:14.605646 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:14.605661 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.606904 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.606909 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:14.607055 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:14.607571 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:14.607587 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:14.610501 (+ 2914us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":960,"threads_started":1}
W20260806 04:46:14.610905 16966 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:14.601439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:40379 (local address 127.7.113.254:42539)
0806 04:46:14.601834 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:14.601840 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:14.601855 (+ 15us) server_negotiation.cc:407] Connection header received
0806 04:46:14.601899 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:14.601905 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:14.601972 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:14.602066 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:14.602908 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.603924 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.605823 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.606598 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.606720 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:14.610648 (+ 3928us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:40379: BlockingRecv error: recv got EOF from 127.7.113.195:40379 (error 108)
Metrics: {"server-negotiator.queue_time_us":274}
W20260806 04:46:14.611028 16964 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 04:46:14 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:14 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:14.814458 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:14.806075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:48655)
0806 04:46:14.806649 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:14.806666 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:14.806777 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:14.807092 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:14.807096 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:14.807504 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:14.807646 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:14.807653 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.808624 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.808628 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:14.809561 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:14.809571 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.810212 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.810216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:14.810333 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:14.810877 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:14.810893 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:14.814163 (+ 3270us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":340,"threads_started":1}
W20260806 04:46:14.814620 16966 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:14.806150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:48655 (local address 127.7.113.254:42539)
0806 04:46:14.806302 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:14.806306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:14.806732 (+ 426us) server_negotiation.cc:407] Connection header received
0806 04:46:14.806877 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:14.806881 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:14.806968 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:14.807044 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:14.807771 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.808502 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.809676 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:14.810067 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:14.810153 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:14.814406 (+ 4253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:48655: BlockingRecv error: recv got EOF from 127.7.113.194:48655 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 06 04:46:15 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:15 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:15.616922 16977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:15.607104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:37167)
0806 04:46:15.607668 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:15.607690 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:15.607822 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:15.608356 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:15.608359 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:15.608736 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:15.608915 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:15.608923 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:15.609888 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:15.609891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:15.610773 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:15.610783 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:15.611480 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:15.611486 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:15.611690 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:15.612429 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:15.612458 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:15.616548 (+ 4090us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":314,"threads_started":1}
W20260806 04:46:15.617573 16976 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:15.607133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:37167 (local address 127.7.113.254:42539)
0806 04:46:15.608047 (+ 914us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:15.608051 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:15.608066 (+ 15us) server_negotiation.cc:407] Connection header received
0806 04:46:15.608107 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:15.608110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:15.608162 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:15.608245 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:15.609030 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:15.609755 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:15.610882 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:15.611296 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:15.611433 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:15.616855 (+ 5422us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:37167: BlockingRecv error: recv got EOF from 127.7.113.193:37167 (error 108)
Metrics: {"server-negotiator.queue_time_us":831,"thread_start_us":702,"threads_started":1}
Aug 06 04:46:15 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:15 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:15.621497 16978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:15.611578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:53501)
0806 04:46:15.612406 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:15.612424 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:15.612553 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:15.612870 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:15.612876 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:15.613364 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:15.613552 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:15.613566 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:15.614813 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:15.614820 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:15.616120 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:15.616132 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:15.617243 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:15.617252 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:15.617448 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:15.618027 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:15.618049 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:15.621278 (+ 3229us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":705,"thread_start_us":582,"threads_started":1}
W20260806 04:46:15.621842 16979 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:15.611669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:53501 (local address 127.7.113.254:42539)
0806 04:46:15.612215 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:15.612220 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:15.612498 (+ 278us) server_negotiation.cc:407] Connection header received
0806 04:46:15.612653 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:15.612656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:15.612701 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:15.612777 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:15.613690 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:15.614670 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:15.616300 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:15.616879 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:15.616992 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:15.621482 (+ 4490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:53501: BlockingRecv error: recv got EOF from 127.7.113.195:53501 (error 108)
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":262,"threads_started":1}
Aug 06 04:46:15 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:15 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:15.824399 16980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:15.815702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:59227)
0806 04:46:15.816294 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:15.816318 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:15.816467 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:15.816815 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:15.816820 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:15.817231 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:15.817409 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:15.817417 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:15.818406 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:15.818413 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:15.819323 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:15.819333 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:15.820007 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:15.820013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:15.820188 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:15.820824 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:15.820841 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:15.824033 (+ 3192us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":306,"threads_started":1}
W20260806 04:46:15.824488 16979 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:15.815753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:59227 (local address 127.7.113.254:42539)
0806 04:46:15.815957 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:15.815964 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:15.816399 (+ 435us) server_negotiation.cc:407] Connection header received
0806 04:46:15.816586 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:15.816592 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:15.816662 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:15.816760 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:15.817550 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:15.818265 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:15.819459 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:15.819864 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:15.819990 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:15.824226 (+ 4236us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:59227: BlockingRecv error: recv got EOF from 127.7.113.194:59227 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 06 04:46:16 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:16 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:16.627972 16981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:16.618047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:45679)
0806 04:46:16.618557 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:16.618573 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:16.618676 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:16.619145 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:16.619149 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:16.619659 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:16.619893 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:16.619904 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:16.621284 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:16.621288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:16.622407 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:16.622419 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:16.623255 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:16.623261 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:16.623453 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:16.624060 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:16.624076 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:16.627621 (+ 3545us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":278,"threads_started":1}
W20260806 04:46:16.628129 16982 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:16.618227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:45679 (local address 127.7.113.254:42539)
0806 04:46:16.618898 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:16.618903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:16.618918 (+ 15us) server_negotiation.cc:407] Connection header received
0806 04:46:16.618960 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:16.618964 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:16.619017 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:16.619101 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:16.620086 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:16.621161 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:16.622534 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:16.623111 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:16.623243 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:16.627850 (+ 4607us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:45679: BlockingRecv error: recv got EOF from 127.7.113.193:45679 (error 108)
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":448,"threads_started":1}
Aug 06 04:46:16 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:16 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:16.632385 16983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:16.622350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:52121)
0806 04:46:16.623063 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:16.623077 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:16.623185 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:16.623497 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:16.623505 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:16.623906 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:16.624075 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:16.624084 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:16.625110 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:16.625113 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:16.626298 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:16.626313 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:16.627454 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:16.627460 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:16.627633 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:16.628313 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:16.628335 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:16.632025 (+ 3690us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":525,"threads_started":1}
W20260806 04:46:16.632624 16984 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:16.622409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:52121 (local address 127.7.113.254:42539)
0806 04:46:16.622920 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:16.622925 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:16.623150 (+ 225us) server_negotiation.cc:407] Connection header received
0806 04:46:16.623296 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:16.623302 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:16.623359 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:16.623458 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:16.624205 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:16.624963 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:16.626477 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:16.627099 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:16.627208 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:16.632248 (+ 5040us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:52121: BlockingRecv error: recv got EOF from 127.7.113.195:52121 (error 108)
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":246,"threads_started":1}
Aug 06 04:46:16 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:16 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:16.834640 16985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:16.825445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:35277)
0806 04:46:16.826027 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:16.826044 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:16.826170 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:16.826482 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:16.826485 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:16.826885 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:16.827046 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:16.827054 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:16.828101 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:16.828105 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:16.829092 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:16.829104 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:16.829776 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:16.829796 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:16.829985 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:16.830667 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:16.830684 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:16.834399 (+ 3715us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":323,"threads_started":1}
W20260806 04:46:16.834776 16984 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:16.825509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:35277 (local address 127.7.113.254:42539)
0806 04:46:16.825671 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:16.825676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:16.826114 (+ 438us) server_negotiation.cc:407] Connection header received
0806 04:46:16.826271 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:16.826274 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:16.826335 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:16.826472 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:16.827168 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:16.827970 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:16.829208 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:16.829613 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:16.829764 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:16.834573 (+ 4809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:35277: BlockingRecv error: recv got EOF from 127.7.113.194:35277 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 04:46:17 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:17 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:17 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:17 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:17.643708 16989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:17.633494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:38123)
0806 04:46:17.634420 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:17.634434 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:17.634537 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:17.634806 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:17.634809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:17.635156 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:17.635315 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:17.635323 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:17.636237 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:17.636240 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:17.637172 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:17.637184 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:17.637945 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:17.637950 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:17.638151 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:17.639959 (+ 1808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:17.639982 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:17.643468 (+ 3486us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":819,"thread_start_us":703,"threads_started":1}
W20260806 04:46:17.644007 16988 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:17.633503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:38123 (local address 127.7.113.254:42539)
0806 04:46:17.634062 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:17.634068 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:17.634509 (+ 441us) server_negotiation.cc:407] Connection header received
0806 04:46:17.634629 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:17.634632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:17.634682 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:17.634768 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:17.635437 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:17.636125 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:17.637288 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:17.637794 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:17.637923 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:17.643691 (+ 5768us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:38123: BlockingRecv error: recv got EOF from 127.7.113.195:38123 (error 108)
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":245,"threads_started":1}
I20260806 04:46:17.644167 16986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:17.628940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:47657)
0806 04:46:17.629483 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:17.629500 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:17.629604 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:17.629921 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:17.629924 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:17.630310 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:17.630475 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:17.630483 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:17.631527 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:17.631532 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:17.632661 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:17.632675 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:17.633395 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:17.633404 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:17.633602 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:17.640002 (+ 6400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:17.640020 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:17.643815 (+ 3795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":253,"threads_started":1}
W20260806 04:46:17.644428 16987 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:17.629039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:47657 (local address 127.7.113.254:42539)
0806 04:46:17.629568 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:17.629572 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:17.629588 (+ 16us) server_negotiation.cc:407] Connection header received
0806 04:46:17.629715 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:17.629719 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:17.629775 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:17.629862 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:17.630587 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:17.631409 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:17.632773 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:17.633231 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:17.633363 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:17.644078 (+ 10715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:47657: BlockingRecv error: recv got EOF from 127.7.113.193:47657 (error 108)
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":276,"threads_started":1}
Aug 06 04:46:17 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:17 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:17.844763 16990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:17.835720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:49557)
0806 04:46:17.836192 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:17.836207 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:17.836392 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:17.836670 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:17.836674 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:17.837045 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:17.837204 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:17.837211 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:17.838488 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:17.838494 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:17.839553 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:17.839564 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:17.840287 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:17.840294 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:17.840478 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:17.841057 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:17.841074 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:17.844407 (+ 3333us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":274,"threads_started":1}
W20260806 04:46:17.844852 16987 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:17.835792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:49557 (local address 127.7.113.254:42539)
0806 04:46:17.836067 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:17.836073 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:17.836333 (+ 260us) server_negotiation.cc:407] Connection header received
0806 04:46:17.836492 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:17.836496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:17.836557 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:17.836635 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:17.837341 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:17.838347 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:17.839694 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:17.840110 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:17.840240 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:17.844615 (+ 4375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:49557: BlockingRecv error: recv got EOF from 127.7.113.194:49557 (error 108)
Metrics: {"server-negotiator.queue_time_us":123}
Aug 06 04:46:18 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:18 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:18 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:18 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:18.669826 16993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:18.645211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:58901)
0806 04:46:18.658363 (+ 13152us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:18.658383 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:18.658564 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:18.659210 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:18.659228 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:18.659788 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:18.659956 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:18.659964 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:18.661280 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:18.661285 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:18.662393 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:18.662408 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:18.664020 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:18.664025 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:18.664208 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:18.664880 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:18.664902 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:18.669519 (+ 4617us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":13021,"thread_start_us":12918,"threads_started":1}
I20260806 04:46:18.669878 16991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:18.644978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:49317)
0806 04:46:18.658227 (+ 13249us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:18.658248 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:18.658405 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:18.659011 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:18.659017 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:18.660323 (+ 1306us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:18.660534 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:18.660546 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:18.662062 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:18.662067 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:18.663479 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:18.663495 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:18.664673 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:18.664680 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:18.664847 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:18.665392 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:18.665409 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:18.669512 (+ 4103us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":13128,"thread_start_us":13486,"threads_started":1}
W20260806 04:46:18.670204 16992 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:18.645244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:58901 (local address 127.7.113.254:42539)
0806 04:46:18.657935 (+ 12691us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:18.657944 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:18.658461 (+ 517us) server_negotiation.cc:407] Connection header received
0806 04:46:18.658716 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:18.658723 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:18.658826 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:18.658934 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:18.660100 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:18.661146 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:18.662854 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:18.663577 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:18.663732 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:18.669861 (+ 6129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:58901: BlockingRecv error: recv got EOF from 127.7.113.193:58901 (error 108)
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":12557,"thread_start_us":12139,"threads_started":1}
W20260806 04:46:18.670226 16994 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:18.645053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:49317 (local address 127.7.113.254:42539)
0806 04:46:18.657356 (+ 12303us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:18.657365 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:18.658340 (+ 975us) server_negotiation.cc:407] Connection header received
0806 04:46:18.658577 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:18.658582 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:18.658661 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:18.658770 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:18.660698 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:18.661914 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:18.663659 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:18.664456 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:18.664580 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:18.669853 (+ 5273us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:49317: BlockingRecv error: recv got EOF from 127.7.113.195:49317 (error 108)
Metrics: {"mutex_wait_us":77,"server-negotiator.queue_time_us":12174,"thread_start_us":12725,"threads_started":1}
Aug 06 04:46:18 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:18 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:18.854820 16995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:18.845717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:43383)
0806 04:46:18.846299 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:18.846314 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:18.846474 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:18.846797 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:18.846801 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:18.847227 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:18.847392 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:18.847400 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:18.848481 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:18.848489 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:18.849464 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:18.849476 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:18.850356 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:18.850362 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:18.850523 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:18.851274 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:18.851296 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:18.854554 (+ 3258us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":330,"threads_started":1}
W20260806 04:46:18.854974 16994 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:18.845966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:43383 (local address 127.7.113.254:42539)
0806 04:46:18.846195 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:18.846201 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:18.846406 (+ 205us) server_negotiation.cc:407] Connection header received
0806 04:46:18.846593 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:18.846598 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:18.846667 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:18.846765 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:18.847528 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:18.848346 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:18.849601 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:18.850202 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:18.850316 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:18.854738 (+ 4422us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:43383: BlockingRecv error: recv got EOF from 127.7.113.194:43383 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 06 04:46:19 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:19 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:19 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:19 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:19.681474 16996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:19.670640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:56049)
0806 04:46:19.671167 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:19.671188 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:19.671308 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:19.672236 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:19.672242 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:19.672711 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:19.672865 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:19.672874 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:19.674139 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:19.674144 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:19.675216 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:19.675229 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:19.676183 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:19.676190 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:19.676396 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:19.676865 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:19.676886 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:19.681157 (+ 4271us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":255,"threads_started":1}
I20260806 04:46:19.681771 16998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:19.671230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:55587)
0806 04:46:19.671809 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:19.671829 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:19.671948 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:19.672276 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:19.672283 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:19.672715 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:19.672868 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:19.672876 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:19.674083 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:19.674088 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:19.675061 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:19.675073 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:19.675917 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:19.675921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:19.676041 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:19.676653 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:19.676673 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:19.681427 (+ 4754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":293,"threads_started":1}
W20260806 04:46:19.681682 16997 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:19.670731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:56049 (local address 127.7.113.254:42539)
0806 04:46:19.671907 (+ 1176us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:19.671912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:19.671930 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:46:19.671987 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:19.671995 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:19.672075 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:19.672193 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:19.673002 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:19.674004 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:19.675356 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:19.676022 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:19.676120 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:19.681365 (+ 5245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:56049: BlockingRecv error: recv got EOF from 127.7.113.195:56049 (error 108)
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":645,"spinlock_wait_cycles":5504,"thread_start_us":510,"threads_started":1}
W20260806 04:46:19.682313 16999 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:19.671488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:55587 (local address 127.7.113.254:42539)
0806 04:46:19.671961 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:19.671965 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:19.671980 (+ 15us) server_negotiation.cc:407] Connection header received
0806 04:46:19.672061 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:19.672064 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:19.672112 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:19.672221 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:19.673000 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:19.673948 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:19.675186 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:19.675767 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:19.675896 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:19.681764 (+ 5868us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:55587: BlockingRecv error: recv got EOF from 127.7.113.193:55587 (error 108)
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":381,"spinlock_wait_cycles":7680,"thread_start_us":237,"threads_started":1}
Aug 06 04:46:19 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:19 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:19.863894 17000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:19.855725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:39281)
0806 04:46:19.856239 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:19.856279 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:19.856390 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:19.856655 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:19.856658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:19.857074 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:19.857240 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:19.857248 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:19.858195 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:19.858199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:19.859103 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:19.859113 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:19.859725 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:19.859728 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:19.859863 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:19.860461 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:19.860477 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:19.863678 (+ 3201us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":278,"threads_started":1}
W20260806 04:46:19.864110 16999 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:19.855759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:39281 (local address 127.7.113.254:42539)
0806 04:46:19.855921 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:19.855925 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:19.856339 (+ 414us) server_negotiation.cc:407] Connection header received
0806 04:46:19.856481 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:19.856485 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:19.856544 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:19.856614 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:19.857362 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:19.858084 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:19.859222 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:19.859606 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:19.859691 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:19.863875 (+ 4184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:39281: BlockingRecv error: recv got EOF from 127.7.113.194:39281 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 04:46:20 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:20 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:20 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:20 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:20.694415 17001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:20.682530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:40853)
0806 04:46:20.683044 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:20.683071 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:20.683234 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:20.684419 (+ 1185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:20.684424 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:20.685022 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:20.685258 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:20.685271 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:20.686833 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:20.686837 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:20.688312 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:20.688327 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:20.689237 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:20.689242 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:20.689372 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:20.689994 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:20.690020 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:20.694068 (+ 4048us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":238,"threads_started":1}
W20260806 04:46:20.694533 17004 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:20.682590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:40853 (local address 127.7.113.254:42539)
0806 04:46:20.684033 (+ 1443us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:20.684039 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:20.684057 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:46:20.684121 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:20.684129 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:20.684225 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:20.684383 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:20.685380 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:20.686684 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:20.688443 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:20.689091 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:20.689217 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:20.694252 (+ 5035us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:40853: BlockingRecv error: recv got EOF from 127.7.113.195:40853 (error 108)
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":1323,"thread_start_us":1569,"threads_started":1}
I20260806 04:46:20.694655 17003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:20.682746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:39703)
0806 04:46:20.683763 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:20.683782 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:20.683905 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:20.684904 (+ 999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:20.684909 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:20.685438 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:20.685707 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:20.685720 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:20.687091 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:20.687096 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:20.688577 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:20.688590 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:20.689616 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:20.689624 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:20.689750 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:20.690198 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:20.690220 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:20.694289 (+ 4069us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":878,"thread_start_us":665,"threads_started":1}
W20260806 04:46:20.694957 17002 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:20.683179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:39703 (local address 127.7.113.254:42539)
0806 04:46:20.684609 (+ 1430us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:20.684621 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:20.684638 (+ 17us) server_negotiation.cc:407] Connection header received
0806 04:46:20.684679 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:20.684684 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:20.684747 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:20.684849 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:20.685871 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:20.686975 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:20.688727 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:20.689466 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:20.689551 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:20.694486 (+ 4935us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:39703: BlockingRecv error: recv got EOF from 127.7.113.193:39703 (error 108)
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":1327,"thread_start_us":581,"threads_started":1}
Aug 06 04:46:20 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:20 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:20.873845 17005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:20.865068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:58741)
0806 04:46:20.865732 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:20.865748 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:20.865868 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:20.866152 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:20.866155 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:20.866574 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:20.866737 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:20.866744 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:20.867736 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:20.867740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:20.868738 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:20.868749 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:20.869380 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:20.869384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:20.869490 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:20.870019 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:20.870035 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:20.873563 (+ 3528us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":334,"threads_started":1}
W20260806 04:46:20.874033 17002 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:20.865137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:58741 (local address 127.7.113.254:42539)
0806 04:46:20.865332 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:20.865336 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:20.865826 (+ 490us) server_negotiation.cc:407] Connection header received
0806 04:46:20.865958 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:20.865961 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:20.866017 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:20.866095 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:20.866871 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:20.867609 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:20.868859 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:20.869263 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:20.869350 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:20.873804 (+ 4454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:58741: BlockingRecv error: recv got EOF from 127.7.113.194:58741 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 06 04:46:21 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:21 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:21 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:21 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:21.717965 17008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:21.695831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:37057)
0806 04:46:21.707594 (+ 11763us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:21.707622 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:21.707779 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:21.709046 (+ 1267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:21.709050 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:21.709442 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:21.709608 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:21.709617 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:21.710897 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:21.710901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:21.711796 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:21.711807 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:21.712695 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:21.712702 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:21.712894 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:21.713524 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:21.713542 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:21.717614 (+ 4072us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":11544,"thread_start_us":11404,"threads_started":1}
W20260806 04:46:21.718083 17007 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:21.695965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:37057 (local address 127.7.113.254:42539)
0806 04:46:21.708721 (+ 12756us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:21.708726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:21.708739 (+ 13us) server_negotiation.cc:407] Connection header received
0806 04:46:21.708777 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:21.708780 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:21.708868 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:21.708975 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:21.709795 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:21.710624 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:21.711934 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:21.712523 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:21.712613 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:21.717769 (+ 5156us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:37057: BlockingRecv error: recv got EOF from 127.7.113.193:37057 (error 108)
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":12648,"thread_start_us":12367,"threads_started":1}
I20260806 04:46:21.718225 17006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:21.695598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:47301)
0806 04:46:21.707956 (+ 12358us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:21.707980 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:21.708134 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:21.708950 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:21.708958 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:21.709417 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:21.709589 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:21.709598 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:21.710851 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:21.710857 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:21.711791 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:21.711818 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:21.712733 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:21.712739 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:21.712885 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:21.713592 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:21.713609 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:21.717883 (+ 4274us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":12186,"thread_start_us":12200,"threads_started":1}
W20260806 04:46:21.718382 17009 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:21.695690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:47301 (local address 127.7.113.254:42539)
0806 04:46:21.708631 (+ 12941us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:21.708636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:21.708650 (+ 14us) server_negotiation.cc:407] Connection header received
0806 04:46:21.708710 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:21.708713 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:21.708767 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:21.708854 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:21.709740 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:21.710574 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:21.711970 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:21.712554 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:21.712692 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:21.718076 (+ 5384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:47301: BlockingRecv error: recv got EOF from 127.7.113.195:47301 (error 108)
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":12823,"thread_start_us":12731,"threads_started":1}
Aug 06 04:46:21 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:21 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:21.883941 17010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:21.874734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:35349)
0806 04:46:21.875264 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:21.875291 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:21.875422 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:21.875689 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:21.875692 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:21.876072 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:21.876232 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:21.876240 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:21.877484 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:21.877487 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:21.878445 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:21.878456 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:21.879397 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:21.879402 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:21.879598 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:21.880336 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:21.880355 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:21.883648 (+ 3293us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":228,"threads_started":1}
W20260806 04:46:21.884008 17009 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:21.874791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:35349 (local address 127.7.113.254:42539)
0806 04:46:21.875010 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:21.875017 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:21.875373 (+ 356us) server_negotiation.cc:407] Connection header received
0806 04:46:21.875502 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:21.875505 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:21.875562 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:21.875635 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:21.876401 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:21.877367 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:21.878582 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:21.879208 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:21.879353 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:21.883820 (+ 4467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:35349: BlockingRecv error: recv got EOF from 127.7.113.194:35349 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 06 04:46:22 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:22 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:22 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:22 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
W20260806 04:46:22.735951 17014 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:22.719366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:59925 (local address 127.7.113.254:42539)
0806 04:46:22.722997 (+ 3631us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:22.723003 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:22.723579 (+ 576us) server_negotiation.cc:407] Connection header received
0806 04:46:22.723642 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:22.723646 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:22.723736 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:22.723889 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:22.724887 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:22.725934 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:22.727316 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:22.727715 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:22.727841 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:22.735633 (+ 7792us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:59925: BlockingRecv error: recv got EOF from 127.7.113.195:59925 (error 108)
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":3498,"thread_start_us":4193,"threads_started":1}
I20260806 04:46:22.735780 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:22.719305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:59925)
0806 04:46:22.723245 (+ 3940us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:22.723270 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:22.723444 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:22.723951 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:22.723956 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:22.724571 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:22.724743 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:22.724752 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:22.726067 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:22.726073 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:22.727176 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:22.727188 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:22.727901 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:22.727907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:22.728074 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:22.731767 (+ 3693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:22.731784 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:22.735437 (+ 3653us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":3756,"thread_start_us":3607,"threads_started":1}
I20260806 04:46:22.736033 17011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:22.719298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:56805)
0806 04:46:22.723542 (+ 4244us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:22.723562 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:22.723704 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:22.724481 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:22.724485 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:22.724893 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:22.725044 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:22.725052 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:22.726429 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:22.726435 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:22.727465 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:22.727477 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:22.728237 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:22.728243 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:22.728450 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:22.731714 (+ 3264us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:22.731732 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:22.735707 (+ 3975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":4105,"thread_start_us":3983,"threads_started":1}
W20260806 04:46:22.736474 17013 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:22.719366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:56805 (local address 127.7.113.254:42539)
0806 04:46:22.724131 (+ 4765us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:22.724137 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:22.724155 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:46:22.724199 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:22.724205 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:22.724303 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:22.724402 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:22.725293 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:22.726265 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:22.727597 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:22.728080 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:22.728201 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:22.736108 (+ 7907us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:56805: BlockingRecv error: recv got EOF from 127.7.113.193:56805 (error 108)
Metrics: {"mutex_wait_us":114,"server-negotiator.queue_time_us":4367,"thread_start_us":3259,"threads_started":1}
Aug 06 04:46:22 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:22 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:22.893599 17015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:22.885056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:40171)
0806 04:46:22.885587 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:22.885603 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:22.885704 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:22.885990 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:22.885993 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:22.886408 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:22.886548 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:22.886556 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:22.887499 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:22.887502 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:22.888434 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:22.888444 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:22.889109 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:22.889115 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:22.889285 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:22.889899 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:22.889916 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:22.893263 (+ 3347us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":293,"threads_started":1}
W20260806 04:46:22.893680 17013 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:22.885088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:40171 (local address 127.7.113.254:42539)
0806 04:46:22.885238 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:22.885243 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:22.885665 (+ 422us) server_negotiation.cc:407] Connection header received
0806 04:46:22.885805 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:22.885808 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:22.885877 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:22.885949 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:22.886662 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:22.887393 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:22.888571 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:22.888968 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:22.889090 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:22.893454 (+ 4364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:40171: BlockingRecv error: recv got EOF from 127.7.113.194:40171 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 06 04:46:23 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:23 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:23 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:23 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:23.747730 17016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:23.736923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:48239)
0806 04:46:23.737546 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:23.737572 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:23.737743 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:23.738855 (+ 1112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:23.738862 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:23.739250 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:23.739475 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:23.739491 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:23.740669 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:23.740673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:23.741675 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:23.741689 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:23.742797 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:23.742803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:23.743016 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:23.743616 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:23.743658 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:23.747411 (+ 3753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":286,"threads_started":1}
I20260806 04:46:23.747743 17018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:23.737110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:33777)
0806 04:46:23.738338 (+ 1228us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:23.738361 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:23.738449 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:23.738696 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:23.738699 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:23.739066 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:23.739215 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:23.739223 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:23.740392 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:23.740398 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:23.741471 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:23.741483 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:23.742544 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:23.742549 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:23.742745 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:23.743543 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:23.743579 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:23.747405 (+ 3826us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1121,"thread_start_us":1027,"threads_started":1}
W20260806 04:46:23.747969 17017 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:23.737005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:48239 (local address 127.7.113.254:42539)
0806 04:46:23.737809 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:23.737817 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:23.737854 (+ 37us) server_negotiation.cc:407] Connection header received
0806 04:46:23.737919 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:23.737926 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:23.738070 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:23.738789 (+ 719us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:23.739628 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:23.740541 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:23.741831 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:23.742614 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:23.742738 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:23.747640 (+ 4902us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:48239: BlockingRecv error: recv got EOF from 127.7.113.195:48239 (error 108)
Metrics: {"server-negotiator.queue_time_us":686,"thread_start_us":526,"threads_started":1}
W20260806 04:46:23.747990 17019 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:23.737700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:33777 (local address 127.7.113.254:42539)
0806 04:46:23.738472 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:23.738476 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:23.738506 (+ 30us) server_negotiation.cc:407] Connection header received
0806 04:46:23.738537 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:23.738540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:23.738579 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:23.738652 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:23.739361 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:23.740227 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:23.741614 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:23.742184 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:23.742316 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:23.747643 (+ 5327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:33777: BlockingRecv error: recv got EOF from 127.7.113.193:33777 (error 108)
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":696,"thread_start_us":569,"threads_started":1}
Aug 06 04:46:23 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:23 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:23.903367 17020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:23.894539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:45653)
0806 04:46:23.895103 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:23.895310 (+ 207us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:23.895450 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:23.895800 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:23.895804 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:23.896226 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:23.896483 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:23.896494 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:23.897499 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:23.897505 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:23.898423 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:23.898433 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:23.899106 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:23.899112 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:23.899262 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:23.899832 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:23.899850 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:23.902985 (+ 3135us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":293,"threads_started":1}
W20260806 04:46:23.903394 17019 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:23.894647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:45653 (local address 127.7.113.254:42539)
0806 04:46:23.894818 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:23.894822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:23.895402 (+ 580us) server_negotiation.cc:407] Connection header received
0806 04:46:23.895561 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:23.895565 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:23.895647 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:23.895762 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:23.896617 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:23.897367 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:23.898570 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:23.898959 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:23.899076 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:23.903178 (+ 4102us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:45653: BlockingRecv error: recv got EOF from 127.7.113.194:45653 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 04:46:24 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:24 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:24 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:24 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:24.759007 17021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:24.748719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:38751)
0806 04:46:24.749862 (+ 1143us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:24.749886 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:24.750016 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:24.750490 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:24.750495 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:24.750933 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:24.751102 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:24.751111 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:24.752214 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:24.752220 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:24.753178 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:24.753190 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:24.753965 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:24.753970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:24.754157 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:24.754822 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:24.754866 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:24.758761 (+ 3895us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1012,"thread_start_us":918,"threads_started":1}
I20260806 04:46:24.759454 17023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:24.749032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:54423)
0806 04:46:24.749628 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:24.749654 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:24.749806 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:24.750587 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:24.750592 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:24.751009 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:24.751162 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:24.751172 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:24.752319 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:24.752330 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:24.753285 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:24.753296 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:24.754058 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:24.754063 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:24.754250 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:24.755102 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:24.755118 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:24.759128 (+ 4010us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":280,"threads_started":1}
W20260806 04:46:24.760020 17024 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:24.748893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:38751 (local address 127.7.113.254:42539)
0806 04:46:24.750212 (+ 1319us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:24.750217 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:24.750229 (+ 12us) server_negotiation.cc:407] Connection header received
0806 04:46:24.750273 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:24.750276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:24.750332 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:24.750447 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:24.751249 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:24.752083 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:24.753336 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:24.753813 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:24.753944 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:24.758980 (+ 5036us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:38751: BlockingRecv error: recv got EOF from 127.7.113.193:38751 (error 108)
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":1197,"thread_start_us":1191,"threads_started":1}
W20260806 04:46:24.760526 17022 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:24.749382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:54423 (local address 127.7.113.254:42539)
0806 04:46:24.750325 (+ 943us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:24.750329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:24.750342 (+ 13us) server_negotiation.cc:407] Connection header received
0806 04:46:24.750379 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:24.750382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:24.750429 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:24.750543 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:24.751341 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:24.752158 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:24.753426 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:24.753902 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:24.754025 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:24.760074 (+ 6049us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:54423: BlockingRecv error: recv got EOF from 127.7.113.195:54423 (error 108)
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":856,"thread_start_us":552,"threads_started":1}
Aug 06 04:46:24 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:24 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:24.912962 17025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:24.904336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:39663)
0806 04:46:24.904849 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:24.904865 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:24.904975 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:24.905275 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:24.905278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:24.905688 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:24.905881 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:24.905890 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:24.906841 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:24.906844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:24.907887 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:24.907899 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:24.908525 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:24.908529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:24.908646 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:24.909270 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:24.909289 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:24.912643 (+ 3354us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":293,"threads_started":1}
W20260806 04:46:24.913060 17022 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:24.904410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:39663 (local address 127.7.113.254:42539)
0806 04:46:24.904591 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:24.904595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:24.904938 (+ 343us) server_negotiation.cc:407] Connection header received
0806 04:46:24.905067 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:24.905071 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:24.905144 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:24.905222 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:24.905999 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:24.906722 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:24.908005 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:24.908405 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:24.908490 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:24.912814 (+ 4324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:39663: BlockingRecv error: recv got EOF from 127.7.113.194:39663 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 06 04:46:25 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:25 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:25 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:25 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:25.783282 17026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:25.760055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:55099)
0806 04:46:25.773647 (+ 13592us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:25.773670 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:25.773823 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:25.774205 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:25.774211 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:25.774791 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:25.774964 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:25.774973 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:25.776114 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:25.776122 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:25.777127 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:25.777139 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:25.777870 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:25.777876 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:25.778092 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:25.778741 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:25.778766 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:25.782924 (+ 4158us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":13455,"thread_start_us":13350,"threads_started":1}
W20260806 04:46:25.783524 17027 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:25.760218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:55099 (local address 127.7.113.254:42539)
0806 04:46:25.772706 (+ 12488us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:25.772716 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:25.773778 (+ 1062us) server_negotiation.cc:407] Connection header received
0806 04:46:25.773960 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:25.773964 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:25.774048 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:25.774134 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:25.775113 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:25.775983 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:25.777269 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:25.777717 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:25.777860 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:25.783225 (+ 5365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:55099: BlockingRecv error: recv got EOF from 127.7.113.193:55099 (error 108)
Metrics: {"server-negotiator.queue_time_us":12301,"spinlock_wait_cycles":896,"thread_start_us":12466,"threads_started":1}
I20260806 04:46:25.783743 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:25.760364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:57895)
0806 04:46:25.773287 (+ 12923us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:25.773314 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:25.773488 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:25.774370 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:25.774375 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:25.774882 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:25.775057 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:25.775066 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:25.776241 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:25.776247 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:25.777185 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:25.777196 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:25.778000 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:25.778006 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:25.778202 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:25.778906 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:25.778923 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:25.783315 (+ 4392us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":12746,"thread_start_us":12617,"threads_started":1}
W20260806 04:46:25.784018 17028 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:25.760370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:57895 (local address 127.7.113.254:42539)
0806 04:46:25.774023 (+ 13653us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:25.774027 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:25.774040 (+ 13us) server_negotiation.cc:407] Connection header received
0806 04:46:25.774076 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:25.774079 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:25.774201 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:25.774311 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:25.775218 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:25.776108 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:25.777336 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:25.777824 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:25.777962 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:25.783562 (+ 5600us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:57895: BlockingRecv error: recv got EOF from 127.7.113.195:57895 (error 108)
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":13535,"spinlock_wait_cycles":768,"thread_start_us":13379,"threads_started":1}
Aug 06 04:46:25 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:25 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:25.923002 17030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:25.914039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:40911)
0806 04:46:25.914572 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:25.914586 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:25.914695 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:25.915049 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:25.915052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:25.915452 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:25.915623 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:25.915631 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:25.916703 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:25.916707 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:25.917641 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:25.917650 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:25.918299 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:25.918303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:25.918426 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:25.918986 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:25.919003 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:25.922766 (+ 3763us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":293,"threads_started":1}
W20260806 04:46:25.923185 17028 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:25.914087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:40911 (local address 127.7.113.254:42539)
0806 04:46:25.914328 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:25.914337 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:25.914667 (+ 330us) server_negotiation.cc:407] Connection header received
0806 04:46:25.914790 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:25.914794 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:25.914899 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:25.914979 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:25.915740 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:25.916575 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:25.917757 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:25.918147 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:25.918237 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:25.922947 (+ 4710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:40911: BlockingRecv error: recv got EOF from 127.7.113.194:40911 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 06 04:46:26 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:26 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:26 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:26 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:26.801957 17031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:26.784504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:42001)
0806 04:46:26.791122 (+ 6618us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:26.791151 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:26.791334 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:26.792644 (+ 1310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:26.792652 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:26.793264 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:26.793421 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:26.793431 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:26.794706 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:26.794712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:26.795802 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:26.795815 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:26.796764 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:26.796772 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:26.796965 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:26.797720 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:26.797737 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:26.801604 (+ 3867us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":6443,"thread_start_us":6372,"threads_started":1}
W20260806 04:46:26.802095 17034 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:26.784573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:42001 (local address 127.7.113.254:42539)
0806 04:46:26.791589 (+ 7016us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:26.791598 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:26.791622 (+ 24us) server_negotiation.cc:407] Connection header received
0806 04:46:26.791704 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:26.791713 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:26.792475 (+ 762us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:26.792595 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:26.793572 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:26.794560 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:26.795962 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:26.796631 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:26.796719 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:26.801821 (+ 5102us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:42001: BlockingRecv error: recv got EOF from 127.7.113.193:42001 (error 108)
Metrics: {"server-negotiator.queue_time_us":6856,"thread_start_us":7860,"threads_started":1}
I20260806 04:46:26.802423 17035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:26.784740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:42459)
0806 04:46:26.792442 (+ 7702us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:26.792463 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:26.792590 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:26.793201 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:26.793205 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:26.793740 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:26.793957 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:26.793969 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:26.795224 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:26.795228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:26.796415 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:26.796430 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:26.797431 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:26.797438 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:26.797673 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:26.798246 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:26.798263 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:26.802102 (+ 3839us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":7572,"thread_start_us":7396,"threads_started":1}
W20260806 04:46:26.802755 17033 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:26.784746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:42459 (local address 127.7.113.254:42539)
0806 04:46:26.792888 (+ 8142us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:26.792892 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:26.792905 (+ 13us) server_negotiation.cc:407] Connection header received
0806 04:46:26.792969 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:26.792973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:26.793043 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:26.793142 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:26.794105 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:26.795080 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:26.796570 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:26.797218 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:26.797325 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:26.802493 (+ 5168us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:42459: BlockingRecv error: recv got EOF from 127.7.113.195:42459 (error 108)
Metrics: {"server-negotiator.queue_time_us":7634,"thread_start_us":6723,"threads_started":1}
Aug 06 04:46:26 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:26 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:26.932407 17036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:26.923996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:35875)
0806 04:46:26.924503 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:26.924518 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:26.924626 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:26.924907 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:26.924910 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:26.925305 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:26.925447 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:26.925455 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:26.926521 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:26.926524 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:26.927423 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:26.927433 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:26.928065 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:26.928069 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:26.928188 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:26.928800 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:26.928817 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:26.932094 (+ 3277us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":299,"threads_started":1}
W20260806 04:46:26.932582 17033 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:26.924132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:35875 (local address 127.7.113.254:42539)
0806 04:46:26.924342 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:26.924347 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:26.924586 (+ 239us) server_negotiation.cc:407] Connection header received
0806 04:46:26.924713 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:26.924716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:26.924773 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:26.924854 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:26.925559 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:26.926403 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:26.927540 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:26.927947 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:26.928037 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:26.932338 (+ 4301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:35875: BlockingRecv error: recv got EOF from 127.7.113.194:35875 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 04:46:27 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:27 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:27 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.195@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:27 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.193@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:27.820583 17039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:27.803349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.195:41279)
0806 04:46:27.804316 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:27.804336 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:27.804428 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:27.805054 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:27.805059 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:27.805599 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:27.805777 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:27.805791 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:27.807571 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:27.807576 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:27.809142 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:27.809157 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:27.810461 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:27.810468 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:27.810657 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:27.813213 (+ 2556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:27.813235 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:27.820211 (+ 6976us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":817,"thread_start_us":727,"threads_started":1}
I20260806 04:46:27.820829 17037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:27.803181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.193:49161)
0806 04:46:27.803769 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:27.803808 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:27.803934 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:27.805058 (+ 1124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:27.805062 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:27.805563 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:27.805814 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:27.805828 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:27.807571 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:27.807576 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:27.809142 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:27.809157 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:27.810255 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:27.810261 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:27.810456 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:27.813282 (+ 2826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:27.813309 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:27.820454 (+ 7145us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":251,"threads_started":1}
W20260806 04:46:27.821228 17040 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:27.803953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:41279 (local address 127.7.113.254:42539)
0806 04:46:27.804690 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:27.804696 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:27.804715 (+ 19us) server_negotiation.cc:407] Connection header received
0806 04:46:27.804769 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:27.804774 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:27.804859 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:27.805006 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:27.805967 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:27.807425 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:27.809302 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:27.810068 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:27.810222 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:27.820656 (+ 10434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.195:41279: BlockingRecv error: recv got EOF from 127.7.113.195:41279 (error 108)
Metrics: {"mutex_wait_us":230,"server-negotiator.queue_time_us":656,"spinlock_wait_cycles":8832,"thread_start_us":368,"threads_started":1}
W20260806 04:46:27.821596 17038 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:27.803302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:49161 (local address 127.7.113.254:42539)
0806 04:46:27.804690 (+ 1388us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:27.804696 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:27.804715 (+ 19us) server_negotiation.cc:407] Connection header received
0806 04:46:27.804769 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:27.804774 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:27.804859 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:27.805006 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:27.805967 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:27.807425 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:27.809348 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:27.810097 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:27.810338 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:27.821330 (+ 10992us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.193:49161: BlockingRecv error: recv got EOF from 127.7.113.193:49161 (error 108)
Metrics: {"mutex_wait_us":189,"server-negotiator.queue_time_us":691,"spinlock_wait_cycles":12032,"thread_start_us":474,"threads_started":1}
Aug 06 04:46:27 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 04:46:27 dist-test-slave-0b58 krb5kdc[15942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.113.194@KRBTEST.COM for oryx/127.7.113.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 04:46:27.942132 17041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:27.933555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42539 (local address 127.7.113.194:47443)
0806 04:46:27.934073 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:27.934088 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:27.934201 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:27.934490 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:27.934493 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:27.934868 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:27.935048 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:27.935055 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:27.936001 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:27.936004 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:27.936950 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:27.936962 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:27.937606 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:27.937611 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:27.937732 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:27.938369 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:27.938387 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:27.941800 (+ 3413us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.113.254:42539: Server oryx/127.7.113.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":267,"threads_started":1}
W20260806 04:46:27.942307 17038 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:27.933656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:47443 (local address 127.7.113.254:42539)
0806 04:46:27.933831 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:27.933836 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:27.934159 (+ 323us) server_negotiation.cc:407] Connection header received
0806 04:46:27.934297 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:27.934301 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:27.934367 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:27.934448 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:27.935164 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:27.935884 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:27.937082 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:27.937486 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:27.937576 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:27.942053 (+ 4477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.113.194:47443: BlockingRecv error: recv got EOF from 127.7.113.194:47443 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 04:46:28.471118 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 16545
I20260806 04:46:28.483570 17043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:28.472199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59472 (local address 127.7.113.193:40419)
0806 04:46:28.472830 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:28.472837 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:28.472864 (+ 27us) server_negotiation.cc:407] Connection header received
0806 04:46:28.472927 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:28.472932 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:28.473164 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:28.473330 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:28.474838 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:28.475929 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:28.477119 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:28.477627 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:28.477720 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:28.480098 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:28.480105 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:28.480118 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:28.480168 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:28.482913 (+ 2745us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.113.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 04:46:28.483248 (+ 335us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59472: Request ticket server kudu/127.7.113.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":346,"threads_started":1}
W20260806 04:46:28.483552 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 16545: Not authorized: Client connection negotiation failed: client connection to 127.7.113.193:40419: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.113.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260806 04:46:28.483682 17043 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59472: Request ticket server kudu/127.7.113.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 04:46:28.483744 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 16545
I20260806 04:46:28.502928 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 16698
I20260806 04:46:28.515290 17044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:28.503985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56368 (local address 127.7.113.194:38579)
0806 04:46:28.504671 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:28.504678 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:28.504702 (+ 24us) server_negotiation.cc:407] Connection header received
0806 04:46:28.504782 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:28.504788 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:28.505081 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:28.505301 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:28.506564 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:28.507690 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:28.508975 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:28.509506 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:28.509647 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:28.512027 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:28.512035 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:28.512047 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:28.512092 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:28.514613 (+ 2521us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.113.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 04:46:28.514969 (+ 356us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56368: Request ticket server kudu/127.7.113.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":325,"threads_started":1}
W20260806 04:46:28.515317 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 16698: Not authorized: Client connection negotiation failed: client connection to 127.7.113.194:38579: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.113.194@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260806 04:46:28.515425 17044 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56368: Request ticket server kudu/127.7.113.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 04:46:28.515513 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 16698
I20260806 04:46:28.534807 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 16835
I20260806 04:46:28.547283 17045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:28.535935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55016 (local address 127.7.113.195:35409)
0806 04:46:28.536727 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:28.536735 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:28.536761 (+ 26us) server_negotiation.cc:407] Connection header received
0806 04:46:28.536836 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:28.536842 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:28.537075 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:28.537225 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:28.539035 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:28.540020 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:28.541257 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:28.541766 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:28.541869 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:28.544233 (+ 2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:28.544241 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:28.544253 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:28.544350 (+ 97us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:28.546716 (+ 2366us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.113.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 04:46:28.546989 (+ 273us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55016: Request ticket server kudu/127.7.113.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":501,"threads_started":1}
W20260806 04:46:28.547310 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 16835: Not authorized: Client connection negotiation failed: client connection to 127.7.113.195:35409: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.113.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 04:46:28.547459 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 16835
W20260806 04:46:28.547421 17045 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55016: Request ticket server kudu/127.7.113.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 04:46:28.563159 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 16475
I20260806 04:46:28.564478 16538 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:28.681984 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 16475
2026-08-06T04:46:28Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21520 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-06T04:46:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:46:28Z Disabled control of system clock
I20260806 04:46:28.766444 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:38339
--webserver_interface=127.7.113.254
--webserver_port=0
--builtin_ntp_servers=127.7.113.212:39307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:38339
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 04:46:29.092677 17050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:29.092957 17050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:29.093037 17050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:29.100062 17050 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:46:29.100162 17050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:29.100201 17050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:29.100306 17050 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:46:29.100373 17050 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:46:29.109542 17050 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:39307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:38339
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:38339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:29.110723 17050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:29.112463 17050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:29.124590 17056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:29.124691 17055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:29.124622 17058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:29.125322 17050 server_base.cc:1034] running on GCE node
I20260806 04:46:29.126027 17050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:29.127265 17050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:29.128459 17050 hybrid_clock.cc:648] HybridClock initialized: now 1785991589128411 us; error 30 us; skew 500 ppm
I20260806 04:46:29.128823 17050 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:46:29.130897 17050 webserver.cc:460] Webserver started at http://127.7.113.254:40343/ using document root <none> and password file <none>
I20260806 04:46:29.131536 17050 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:29.131619 17050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:29.131878 17050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:29.134672 17050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "af051b9a494b4aea824ff00346b8b880"
format_stamp: "Formatted at 2026-08-06 04:46:29 on dist-test-slave-0b58"
server_key: "7067f48fa691b55eb6a941eb8b27441c"
server_key_iv: "52f9f38d846aa2bd0a3213ab20a1bf4a"
server_key_version: "encryptionkey@0"
I20260806 04:46:29.135394 17050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "af051b9a494b4aea824ff00346b8b880"
format_stamp: "Formatted at 2026-08-06 04:46:29 on dist-test-slave-0b58"
server_key: "7067f48fa691b55eb6a941eb8b27441c"
server_key_iv: "52f9f38d846aa2bd0a3213ab20a1bf4a"
server_key_version: "encryptionkey@0"
I20260806 04:46:29.140317 17050 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 04:46:29.143446 17064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:29.144770 17050 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 04:46:29.144906 17050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "af051b9a494b4aea824ff00346b8b880"
format_stamp: "Formatted at 2026-08-06 04:46:29 on dist-test-slave-0b58"
server_key: "7067f48fa691b55eb6a941eb8b27441c"
server_key_iv: "52f9f38d846aa2bd0a3213ab20a1bf4a"
server_key_version: "encryptionkey@0"
I20260806 04:46:29.145073 17050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:29.161487 17050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:29.162166 17050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:29.162397 17050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:29.180557 17050 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:38339
I20260806 04:46:29.180576 17115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:38339 every 8 connection(s)
I20260806 04:46:29.181886 17050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:46:29.185564 17116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:29.188930 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 17050
I20260806 04:46:29.189157 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:46:29.189812 7623 external_mini_cluster.cc:1428] Setting key 5a4ddea58cbb9f749c836bc1a10d6e36
I20260806 04:46:29.196306 17116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880: Bootstrap starting.
I20260806 04:46:29.199775 17116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:29.201117 17116 log.cc:824] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880: Log is configured to *not* fsync() on all Append() calls
I20260806 04:46:29.204399 17116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880: No bootstrap required, opened a new log
I20260806 04:46:29.204649 17119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:29.191720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37738 (local address 127.7.113.254:38339)
0806 04:46:29.192768 (+ 1048us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:29.192790 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:29.192846 (+ 56us) server_negotiation.cc:407] Connection header received
0806 04:46:29.194905 (+ 2059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:29.194927 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:29.195339 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:29.195625 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:29.196371 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:29.197633 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:29.199571 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:29.200379 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:29.200503 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:29.201861 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:29.201870 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:29.201885 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:46:29.202467 (+ 582us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:29.202563 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:46:29.202588 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:29.202705 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:29.203034 (+ 329us) server_negotiation.cc:299] Negotiation successful
0806 04:46:29.203455 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":348,"threads_started":1}
I20260806 04:46:29.212025 17116 raft_consensus.cc:348] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af051b9a494b4aea824ff00346b8b880" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38339 } }
I20260806 04:46:29.212435 17116 raft_consensus.cc:374] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:29.212579 17116 raft_consensus.cc:729] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af051b9a494b4aea824ff00346b8b880, State: Initialized, Role: FOLLOWER
I20260806 04:46:29.213090 17116 consensus_queue.cc:260] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af051b9a494b4aea824ff00346b8b880" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38339 } }
I20260806 04:46:29.213317 17116 raft_consensus.cc:388] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:46:29.213459 17116 raft_consensus.cc:482] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:46:29.213635 17116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:29.215643 17116 raft_consensus.cc:504] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af051b9a494b4aea824ff00346b8b880" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38339 } }
I20260806 04:46:29.216116 17116 leader_election.cc:302] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af051b9a494b4aea824ff00346b8b880; no voters:
I20260806 04:46:29.216687 17116 leader_election.cc:288] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:46:29.216853 17121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:46:29.217598 17121 raft_consensus.cc:686] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [term 1 LEADER]: Becoming Leader. State: Replica: af051b9a494b4aea824ff00346b8b880, State: Running, Role: LEADER
I20260806 04:46:29.218083 17121 consensus_queue.cc:237] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af051b9a494b4aea824ff00346b8b880" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38339 } }
I20260806 04:46:29.218860 17116 sys_catalog.cc:564] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:46:29.221089 17123 sys_catalog.cc:455] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af051b9a494b4aea824ff00346b8b880. Latest consensus state: current_term: 1 leader_uuid: "af051b9a494b4aea824ff00346b8b880" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af051b9a494b4aea824ff00346b8b880" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38339 } } }
I20260806 04:46:29.221335 17122 sys_catalog.cc:455] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af051b9a494b4aea824ff00346b8b880" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af051b9a494b4aea824ff00346b8b880" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38339 } } }
I20260806 04:46:29.221555 17123 sys_catalog.cc:458] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [sys.catalog]: This master's current role is: LEADER
I20260806 04:46:29.221669 17122 sys_catalog.cc:458] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880 [sys.catalog]: This master's current role is: LEADER
I20260806 04:46:29.223640 17130 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:46:29.228454 17130 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:46:29.236546 17130 catalog_manager.cc:1347] Generated new cluster ID: 00f2840547be4d19a009b34710526603
I20260806 04:46:29.236662 17130 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:46:29.265388 17130 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:46:29.266662 17130 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:46:29.278095 17130 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af051b9a494b4aea824ff00346b8b880: Generated new TSK 0
I20260806 04:46:29.278872 17130 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:46:29.290297 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38339
--builtin_ntp_servers=127.7.113.212:39307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 04:46:29.625401 17140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:29.625661 17140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:29.625744 17140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:29.632937 17140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:29.633028 17140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:29.633127 17140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:46:29.642179 17140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:39307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:29.643379 17140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:29.645061 17140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:29.657904 17146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:29.657840 17145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:29.658063 17148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:29.658571 17140 server_base.cc:1034] running on GCE node
I20260806 04:46:29.659240 17140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:29.660208 17140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:29.661444 17140 hybrid_clock.cc:648] HybridClock initialized: now 1785991589661409 us; error 40 us; skew 500 ppm
I20260806 04:46:29.661763 17140 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:46:29.663888 17140 webserver.cc:460] Webserver started at http://127.7.113.193:44473/ using document root <none> and password file <none>
I20260806 04:46:29.664649 17140 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:29.664783 17140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:29.665175 17140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:29.667891 17140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "ad4c5bc63e2e4e119bf982715e1605d7"
format_stamp: "Formatted at 2026-08-06 04:46:29 on dist-test-slave-0b58"
server_key: "87f85c37a88dc26a8393fa3cf4a81dc7"
server_key_iv: "8377d9f2820ddf0ee4fe111bac94b31d"
server_key_version: "encryptionkey@0"
I20260806 04:46:29.668678 17140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "ad4c5bc63e2e4e119bf982715e1605d7"
format_stamp: "Formatted at 2026-08-06 04:46:29 on dist-test-slave-0b58"
server_key: "87f85c37a88dc26a8393fa3cf4a81dc7"
server_key_iv: "8377d9f2820ddf0ee4fe111bac94b31d"
server_key_version: "encryptionkey@0"
I20260806 04:46:29.673826 17140 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260806 04:46:29.677058 17154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:29.678401 17140 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:46:29.678531 17140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "ad4c5bc63e2e4e119bf982715e1605d7"
format_stamp: "Formatted at 2026-08-06 04:46:29 on dist-test-slave-0b58"
server_key: "87f85c37a88dc26a8393fa3cf4a81dc7"
server_key_iv: "8377d9f2820ddf0ee4fe111bac94b31d"
server_key_version: "encryptionkey@0"
I20260806 04:46:29.678694 17140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:29.715880 17140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:29.716766 17140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:29.717021 17140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:29.717866 17140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:29.719354 17140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:29.719463 17140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:29.719547 17140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:29.719602 17140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:29.752811 17140 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:33821
I20260806 04:46:29.752900 17266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:33821 every 8 connection(s)
I20260806 04:46:29.754091 17140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:46:29.760980 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 17140
I20260806 04:46:29.761191 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:46:29.761813 7623 external_mini_cluster.cc:1428] Setting key add2761d82a7e840a9b9d016de8237ed
I20260806 04:46:29.764367 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38339
--builtin_ntp_servers=127.7.113.212:39307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 04:46:29.766125 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:29.756517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:38713 (local address 127.7.113.254:38339)
0806 04:46:29.757005 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:29.757009 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:29.758019 (+ 1010us) server_negotiation.cc:407] Connection header received
0806 04:46:29.759734 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:29.759741 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:29.759830 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:29.759948 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:29.761028 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:29.761882 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:29.763375 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:29.763766 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:29.763894 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:29.765293 (+ 1399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:29.765299 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:29.765304 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:46:29.765332 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:29.765374 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:46:29.765385 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:29.765481 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:29.765701 (+ 220us) server_negotiation.cc:299] Negotiation successful
0806 04:46:29.765803 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":263,"threads_started":1}
I20260806 04:46:29.767042 17270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:29.756987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38339 (local address 127.7.113.193:38713)
0806 04:46:29.757853 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:29.757894 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:29.759476 (+ 1582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:29.760186 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:29.760193 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:29.760331 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:29.760865 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:29.760880 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:29.762055 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:29.762059 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:29.763220 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:29.763241 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:29.763990 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:29.764000 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:29.764236 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:29.764999 (+ 763us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:46:29.765002 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:29.765036 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:46:29.765110 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:29.765480 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:29.765492 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:29.765502 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 04:46:29.765672 (+ 170us) client_negotiation.cc:240] Negotiation successful
0806 04:46:29.766026 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":273,"threads_started":1}
I20260806 04:46:29.768566 17267 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38339
I20260806 04:46:29.768865 17267 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:29.769558 17267 heartbeater.cc:511] Master 127.7.113.254:38339 requested a full tablet report, sending...
I20260806 04:46:29.771733 17081 ts_manager.cc:194] Registered new tserver with Master: ad4c5bc63e2e4e119bf982715e1605d7 (127.7.113.193:33821)
I20260806 04:46:29.773842 17081 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.113.193:38713
W20260806 04:46:30.090297 17271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:30.090543 17271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:30.090631 17271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:30.097620 17271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:30.097711 17271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:30.097822 17271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:46:30.106343 17271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:39307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:30.107491 17271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:30.109220 17271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:30.122308 17276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:30.122272 17279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:30.122321 17277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:30.123667 17271 server_base.cc:1034] running on GCE node
I20260806 04:46:30.124310 17271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:30.125211 17271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:30.126415 17271 hybrid_clock.cc:648] HybridClock initialized: now 1785991590126369 us; error 28 us; skew 500 ppm
I20260806 04:46:30.126734 17271 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:46:30.128901 17271 webserver.cc:460] Webserver started at http://127.7.113.194:40537/ using document root <none> and password file <none>
I20260806 04:46:30.129571 17271 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:30.129683 17271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:30.130021 17271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:30.132788 17271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "1adb7bf5ea504e7e944705a0ea2e8cce"
format_stamp: "Formatted at 2026-08-06 04:46:30 on dist-test-slave-0b58"
server_key: "82ad5fa9afc029cb7df976ed55043427"
server_key_iv: "e3d2f9b8994ff59eb01885ad95841981"
server_key_version: "encryptionkey@0"
I20260806 04:46:30.133558 17271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "1adb7bf5ea504e7e944705a0ea2e8cce"
format_stamp: "Formatted at 2026-08-06 04:46:30 on dist-test-slave-0b58"
server_key: "82ad5fa9afc029cb7df976ed55043427"
server_key_iv: "e3d2f9b8994ff59eb01885ad95841981"
server_key_version: "encryptionkey@0"
I20260806 04:46:30.138437 17271 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 04:46:30.141674 17285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:30.142838 17271 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 04:46:30.143006 17271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "1adb7bf5ea504e7e944705a0ea2e8cce"
format_stamp: "Formatted at 2026-08-06 04:46:30 on dist-test-slave-0b58"
server_key: "82ad5fa9afc029cb7df976ed55043427"
server_key_iv: "e3d2f9b8994ff59eb01885ad95841981"
server_key_version: "encryptionkey@0"
I20260806 04:46:30.143213 17271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:30.186461 17271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:30.187317 17271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:30.187630 17271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:30.188668 17271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:30.190120 17271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:30.190251 17271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:30.190394 17271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:30.190485 17271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:30.227360 17271 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:37857
I20260806 04:46:30.227444 17400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:37857 every 8 connection(s)
I20260806 04:46:30.229142 17271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:46:30.232605 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 17271
I20260806 04:46:30.232848 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:46:30.233440 7623 external_mini_cluster.cc:1428] Setting key a887758385ea03e157d35cc77f2e1e0d
I20260806 04:46:30.236498 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38339
--builtin_ntp_servers=127.7.113.212:39307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 04:46:30.243484 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:30.233532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:36071 (local address 127.7.113.254:38339)
0806 04:46:30.233733 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:30.233739 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:30.234239 (+ 500us) server_negotiation.cc:407] Connection header received
0806 04:46:30.236212 (+ 1973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:30.236216 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:30.236327 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:30.236415 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:30.237780 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:30.238499 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:30.240883 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:30.241256 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:30.241348 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:30.242824 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:30.242829 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:30.242832 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:46:30.242849 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:30.242880 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:46:30.242890 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:30.242957 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:30.243194 (+ 237us) server_negotiation.cc:299] Negotiation successful
0806 04:46:30.243265 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 04:46:30.244920 17403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:30.232941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38339 (local address 127.7.113.194:36071)
0806 04:46:30.234080 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:30.234123 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:30.235926 (+ 1803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:30.236679 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:30.236692 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:30.236806 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:30.237603 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:30.237630 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:30.238657 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:30.238665 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:30.240746 (+ 2081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:30.240763 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:30.241473 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:30.241482 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:30.241792 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:30.242505 (+ 713us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:46:30.242511 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:30.242566 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:46:30.242659 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:30.242982 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:30.242994 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:30.243004 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 04:46:30.243185 (+ 181us) client_negotiation.cc:240] Negotiation successful
0806 04:46:30.243574 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":339,"threads_started":1}
I20260806 04:46:30.246250 17401 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38339
I20260806 04:46:30.246526 17401 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:30.247252 17401 heartbeater.cc:511] Master 127.7.113.254:38339 requested a full tablet report, sending...
I20260806 04:46:30.248842 17081 ts_manager.cc:194] Registered new tserver with Master: 1adb7bf5ea504e7e944705a0ea2e8cce (127.7.113.194:37857)
I20260806 04:46:30.250082 17081 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.113.194:36071
W20260806 04:46:30.562626 17404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:30.562889 17404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:30.562971 17404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:30.569973 17404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:30.570063 17404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:30.570164 17404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:46:30.578629 17404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:39307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:30.579762 17404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:30.581481 17404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:30.593667 17409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:30.593657 17412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:30.593710 17410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:30.595072 17404 server_base.cc:1034] running on GCE node
I20260806 04:46:30.595577 17404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:30.596438 17404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:30.597628 17404 hybrid_clock.cc:648] HybridClock initialized: now 1785991590597592 us; error 24 us; skew 500 ppm
I20260806 04:46:30.597930 17404 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:46:30.600343 17404 webserver.cc:460] Webserver started at http://127.7.113.195:33743/ using document root <none> and password file <none>
I20260806 04:46:30.601006 17404 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:30.601119 17404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:30.601461 17404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:30.604149 17404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "0427a549bd15479eb86425159dcd4ba2"
format_stamp: "Formatted at 2026-08-06 04:46:30 on dist-test-slave-0b58"
server_key: "7e823a317632ce4c8050f754b3f969bd"
server_key_iv: "c941d19ce230453c844839634bc53fff"
server_key_version: "encryptionkey@0"
I20260806 04:46:30.604991 17404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "0427a549bd15479eb86425159dcd4ba2"
format_stamp: "Formatted at 2026-08-06 04:46:30 on dist-test-slave-0b58"
server_key: "7e823a317632ce4c8050f754b3f969bd"
server_key_iv: "c941d19ce230453c844839634bc53fff"
server_key_version: "encryptionkey@0"
I20260806 04:46:30.609887 17404 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:46:30.614617 17419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:30.616475 17404 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 04:46:30.616647 17404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "0427a549bd15479eb86425159dcd4ba2"
format_stamp: "Formatted at 2026-08-06 04:46:30 on dist-test-slave-0b58"
server_key: "7e823a317632ce4c8050f754b3f969bd"
server_key_iv: "c941d19ce230453c844839634bc53fff"
server_key_version: "encryptionkey@0"
I20260806 04:46:30.616920 17404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:30.632731 17404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:30.633482 17404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:30.633735 17404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:30.634604 17404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:30.635947 17404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:30.636031 17404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:30.636116 17404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:30.636169 17404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:30.669387 17404 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:43913
I20260806 04:46:30.669473 17531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:43913 every 8 connection(s)
I20260806 04:46:30.670660 17404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:46:30.675391 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 17404
I20260806 04:46:30.675580 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:46:30.676098 7623 external_mini_cluster.cc:1428] Setting key 54a8101b5c18e466aa7add7e99d34397
I20260806 04:46:30.683193 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:30.673068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:58589 (local address 127.7.113.254:38339)
0806 04:46:30.673284 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:30.673290 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:30.674565 (+ 1275us) server_negotiation.cc:407] Connection header received
0806 04:46:30.676901 (+ 2336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:30.676907 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:30.677018 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:30.677139 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:30.678321 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:30.679052 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:30.680610 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:30.681023 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:30.681158 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:30.682418 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:30.682423 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:30.682426 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:46:30.682443 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:30.682473 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:46:30.682485 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:30.682579 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:30.682788 (+ 209us) server_negotiation.cc:299] Negotiation successful
0806 04:46:30.682877 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 04:46:30.684053 17534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:30.673593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38339 (local address 127.7.113.195:58589)
0806 04:46:30.674420 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:30.674458 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:30.676623 (+ 2165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:30.677364 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:30.677371 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:30.677449 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:30.678157 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:30.678175 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:30.679200 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:30.679211 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:30.680466 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:30.680478 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:30.681236 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:30.681243 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:30.681463 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:30.682117 (+ 654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:46:30.682119 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:30.682153 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:46:30.682220 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:30.682580 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:30.682593 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:30.682602 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 04:46:30.682775 (+ 173us) client_negotiation.cc:240] Negotiation successful
0806 04:46:30.683125 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":263,"threads_started":1}
I20260806 04:46:30.685237 17532 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38339
I20260806 04:46:30.685515 17532 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:30.686225 17532 heartbeater.cc:511] Master 127.7.113.254:38339 requested a full tablet report, sending...
I20260806 04:46:30.687453 17081 ts_manager.cc:194] Registered new tserver with Master: 0427a549bd15479eb86425159dcd4ba2 (127.7.113.195:43913)
I20260806 04:46:30.688220 17081 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.113.195:58589
I20260806 04:46:30.691192 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 04:46:30.697666 17269 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:30.695538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34418 (local address 127.7.113.254:38339)
0806 04:46:30.695716 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:30.695721 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:30.696387 (+ 666us) server_negotiation.cc:407] Connection header received
0806 04:46:30.696633 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:30.696640 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:30.696723 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:30.696790 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:30.697447 (+ 657us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34418: BlockingRecv error: recv got EOF from 127.0.0.1:34418 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 04:46:30.699074 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 17140
I20260806 04:46:30.706540 17541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:30.699927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39332 (local address 127.7.113.193:33821)
0806 04:46:30.700464 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:30.700472 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:30.700508 (+ 36us) server_negotiation.cc:407] Connection header received
0806 04:46:30.700559 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:30.700564 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:30.700728 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:30.700891 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:30.701293 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:30.702250 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:30.703493 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:30.704020 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:30.704159 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:30.705195 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:30.705202 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:30.705213 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:46:30.705744 (+ 531us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:30.705798 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:46:30.705817 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:30.705946 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:30.706062 (+ 116us) server_negotiation.cc:299] Negotiation successful
0806 04:46:30.706206 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":223,"threads_started":1}
I20260806 04:46:30.707638 17262 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:30.786919 17267 heartbeater.cc:503] Master 127.7.113.254:38339 was elected leader, sending a full tablet report...
I20260806 04:46:30.788607 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 17140
W20260806 04:46:30.803256 17067 connection.cc:535] server connection from 127.7.113.193:38713 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 04:46:30.803586 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 17271
I20260806 04:46:30.811087 17543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:30.804459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49530 (local address 127.7.113.194:37857)
0806 04:46:30.804959 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:30.804966 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:30.804991 (+ 25us) server_negotiation.cc:407] Connection header received
0806 04:46:30.805048 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:30.805054 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:30.805269 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:30.805393 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:30.805740 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:30.806728 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:30.807949 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:30.808571 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:30.808664 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:30.809701 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:30.809708 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:30.809719 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:46:30.810312 (+ 593us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:30.810365 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:46:30.810383 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:30.810476 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:30.810585 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 04:46:30.810691 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":249,"threads_started":1}
I20260806 04:46:30.812351 17396 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:30.892498 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 17271
I20260806 04:46:30.909884 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 17404
I20260806 04:46:30.918521 17545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:30.910860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38506 (local address 127.7.113.195:43913)
0806 04:46:30.911502 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:30.911509 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:30.911538 (+ 29us) server_negotiation.cc:407] Connection header received
0806 04:46:30.911600 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:30.911606 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:30.911815 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:30.911989 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:30.912505 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:30.913574 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:30.914905 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:30.915471 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:30.915612 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:30.916927 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:30.916935 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:30.916947 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:46:30.917684 (+ 737us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:30.917735 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:46:30.917754 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:30.917879 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:30.918030 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 04:46:30.918183 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":328,"threads_started":1}
I20260806 04:46:30.919878 17527 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:31.002960 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 17404
I20260806 04:46:31.020849 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 17050
I20260806 04:46:31.022133 17111 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:31.123696 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 17050
2026-08-06T04:46:31Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2437 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-06T04:46:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:46:31Z Disabled control of system clock
I20260806 04:46:31.204082 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:34831
--webserver_interface=127.7.113.254
--webserver_port=0
--builtin_ntp_servers=127.7.113.212:35917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:34831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 04:46:31.525004 17551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:31.525300 17551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:31.525451 17551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:31.532452 17551 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:46:31.532572 17551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:31.532689 17551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:31.532794 17551 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:46:31.532876 17551 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:46:31.542055 17551 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:35917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:34831
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:34831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:31.543468 17551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:31.545286 17551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:31.557150 17557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:31.557174 17556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:31.557236 17559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:31.558028 17551 server_base.cc:1034] running on GCE node
I20260806 04:46:31.558797 17551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:31.560145 17551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:31.561375 17551 hybrid_clock.cc:648] HybridClock initialized: now 1785991591561334 us; error 71 us; skew 500 ppm
I20260806 04:46:31.561721 17551 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:46:31.564110 17551 webserver.cc:460] Webserver started at http://127.7.113.254:34677/ using document root <none> and password file <none>
I20260806 04:46:31.564858 17551 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:31.564987 17551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:31.565301 17551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:31.568188 17551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "db16089eb6504d8291103a921654a99f"
format_stamp: "Formatted at 2026-08-06 04:46:31 on dist-test-slave-0b58"
server_key: "e81f31a5da9d21530d4db323586477b2"
server_key_iv: "94da23aedc3fe6c3c03b8cd732c17079"
server_key_version: "encryptionkey@0"
I20260806 04:46:31.569082 17551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "db16089eb6504d8291103a921654a99f"
format_stamp: "Formatted at 2026-08-06 04:46:31 on dist-test-slave-0b58"
server_key: "e81f31a5da9d21530d4db323586477b2"
server_key_iv: "94da23aedc3fe6c3c03b8cd732c17079"
server_key_version: "encryptionkey@0"
I20260806 04:46:31.573976 17551 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:46:31.577271 17565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:31.578436 17551 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:46:31.578609 17551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "db16089eb6504d8291103a921654a99f"
format_stamp: "Formatted at 2026-08-06 04:46:31 on dist-test-slave-0b58"
server_key: "e81f31a5da9d21530d4db323586477b2"
server_key_iv: "94da23aedc3fe6c3c03b8cd732c17079"
server_key_version: "encryptionkey@0"
I20260806 04:46:31.578814 17551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:31.584378 17551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:31.585091 17551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:31.585386 17551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:31.603504 17551 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:34831
I20260806 04:46:31.603538 17616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:34831 every 8 connection(s)
I20260806 04:46:31.604941 17551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:46:31.608615 17617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:31.614665 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 17551
I20260806 04:46:31.614886 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:46:31.615787 7623 external_mini_cluster.cc:1428] Setting key c2351b8ff0b70b7927679909724e5d98
I20260806 04:46:31.619782 17617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f: Bootstrap starting.
I20260806 04:46:31.623746 17617 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:31.625108 17617 log.cc:824] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f: Log is configured to *not* fsync() on all Append() calls
I20260806 04:46:31.625943 17620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:31.618177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48604 (local address 127.7.113.254:34831)
0806 04:46:31.619367 (+ 1190us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:31.619392 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:31.619565 (+ 173us) server_negotiation.cc:407] Connection header received
0806 04:46:31.622016 (+ 2451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:31.622044 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:31.622545 (+ 501us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:31.622965 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:31.623979 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:31.623986 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:31.624003 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:46:31.624020 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:31.624104 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:46:31.624130 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:31.624351 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:31.624481 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 04:46:31.624727 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":392,"threads_started":1}
I20260806 04:46:31.627880 17617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f: No bootstrap required, opened a new log
I20260806 04:46:31.634917 17617 raft_consensus.cc:348] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db16089eb6504d8291103a921654a99f" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 34831 } }
I20260806 04:46:31.635251 17617 raft_consensus.cc:374] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:31.635370 17617 raft_consensus.cc:729] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db16089eb6504d8291103a921654a99f, State: Initialized, Role: FOLLOWER
I20260806 04:46:31.635968 17617 consensus_queue.cc:260] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db16089eb6504d8291103a921654a99f" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 34831 } }
I20260806 04:46:31.636219 17617 raft_consensus.cc:388] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:46:31.636407 17617 raft_consensus.cc:482] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:46:31.636570 17617 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:31.638988 17617 raft_consensus.cc:504] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db16089eb6504d8291103a921654a99f" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 34831 } }
I20260806 04:46:31.639475 17617 leader_election.cc:302] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db16089eb6504d8291103a921654a99f; no voters:
I20260806 04:46:31.640038 17617 leader_election.cc:288] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:46:31.640177 17622 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:46:31.641456 17622 raft_consensus.cc:686] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [term 1 LEADER]: Becoming Leader. State: Replica: db16089eb6504d8291103a921654a99f, State: Running, Role: LEADER
I20260806 04:46:31.641960 17622 consensus_queue.cc:237] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db16089eb6504d8291103a921654a99f" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 34831 } }
I20260806 04:46:31.642097 17617 sys_catalog.cc:564] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:46:31.644474 17624 sys_catalog.cc:455] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [sys.catalog]: SysCatalogTable state changed. Reason: New leader db16089eb6504d8291103a921654a99f. Latest consensus state: current_term: 1 leader_uuid: "db16089eb6504d8291103a921654a99f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db16089eb6504d8291103a921654a99f" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 34831 } } }
I20260806 04:46:31.644990 17623 sys_catalog.cc:455] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db16089eb6504d8291103a921654a99f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db16089eb6504d8291103a921654a99f" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 34831 } } }
I20260806 04:46:31.645466 17624 sys_catalog.cc:458] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [sys.catalog]: This master's current role is: LEADER
I20260806 04:46:31.645467 17623 sys_catalog.cc:458] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f [sys.catalog]: This master's current role is: LEADER
I20260806 04:46:31.646476 17632 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:46:31.651839 17632 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:46:31.660315 17632 catalog_manager.cc:1347] Generated new cluster ID: ac144d24ffe94064981aa4ac68f68d8b
I20260806 04:46:31.660415 17632 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:46:31.679760 17632 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:46:31.680190 17632 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:46:31.696548 17632 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db16089eb6504d8291103a921654a99f: Generated new TSK 0
I20260806 04:46:31.697279 17632 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:46:31.709422 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:34831
--builtin_ntp_servers=127.7.113.212:35917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 04:46:32.038884 17642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:32.039144 17642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:32.039341 17642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:32.046948 17642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:32.047034 17642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:32.047245 17642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:46:32.055994 17642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:35917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:34831
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:32.057200 17642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:32.058828 17642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:32.071472 17647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:32.071502 17648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:32.071564 17650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:32.072244 17642 server_base.cc:1034] running on GCE node
I20260806 04:46:32.072852 17642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:32.073731 17642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:32.074927 17642 hybrid_clock.cc:648] HybridClock initialized: now 1785991592074870 us; error 52 us; skew 500 ppm
I20260806 04:46:32.075201 17642 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:46:32.077461 17642 webserver.cc:460] Webserver started at http://127.7.113.193:44877/ using document root <none> and password file <none>
I20260806 04:46:32.078101 17642 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:32.078214 17642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:32.078549 17642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:32.081251 17642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "a8d34f6ffbfb473697f8ea94b74642db"
format_stamp: "Formatted at 2026-08-06 04:46:32 on dist-test-slave-0b58"
server_key: "c59ea9855f662d95da45852f775dff2c"
server_key_iv: "9aa284378c33e9c99dac5e5d2492858c"
server_key_version: "encryptionkey@0"
I20260806 04:46:32.082017 17642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "a8d34f6ffbfb473697f8ea94b74642db"
format_stamp: "Formatted at 2026-08-06 04:46:32 on dist-test-slave-0b58"
server_key: "c59ea9855f662d95da45852f775dff2c"
server_key_iv: "9aa284378c33e9c99dac5e5d2492858c"
server_key_version: "encryptionkey@0"
I20260806 04:46:32.086885 17642 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260806 04:46:32.090090 17657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:32.091300 17642 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 04:46:32.091534 17642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "a8d34f6ffbfb473697f8ea94b74642db"
format_stamp: "Formatted at 2026-08-06 04:46:32 on dist-test-slave-0b58"
server_key: "c59ea9855f662d95da45852f775dff2c"
server_key_iv: "9aa284378c33e9c99dac5e5d2492858c"
server_key_version: "encryptionkey@0"
I20260806 04:46:32.091735 17642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:32.097432 17642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:32.098160 17642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:32.098434 17642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:32.099349 17642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:32.100828 17642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:32.100919 17642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:32.101063 17642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:32.101157 17642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:32.134420 17642 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:46481
I20260806 04:46:32.134510 17770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:46481 every 8 connection(s)
I20260806 04:46:32.135746 17642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:46:32.137477 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 17642
I20260806 04:46:32.137683 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:46:32.138558 7623 external_mini_cluster.cc:1428] Setting key efb483af754c07bff06faf055d77d506
I20260806 04:46:32.141690 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:34831
--builtin_ntp_servers=127.7.113.212:35917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 04:46:32.144970 17773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:32.138518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:58103 (local address 127.7.113.254:34831)
0806 04:46:32.139731 (+ 1213us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:32.139737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:32.140572 (+ 835us) server_negotiation.cc:407] Connection header received
0806 04:46:32.142501 (+ 1929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:32.142507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:32.142574 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:32.142703 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:32.144154 (+ 1451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:32.144159 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:32.144164 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:46:32.144182 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:32.144233 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:46:32.144245 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:32.144416 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:32.144608 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 04:46:32.144688 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1053,"thread_start_us":939,"threads_started":1}
I20260806 04:46:32.146080 17774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:32.139213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:34831 (local address 127.7.113.193:58103)
0806 04:46:32.140245 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:32.140459 (+ 214us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:32.142219 (+ 1760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:32.142939 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:32.142947 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:32.143033 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:32.143836 (+ 803us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:46:32.143842 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:32.143892 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:46:32.143990 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:32.144379 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:32.144390 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:32.144400 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 04:46:32.144687 (+ 287us) client_negotiation.cc:240] Negotiation successful
0806 04:46:32.144928 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":346,"threads_started":1}
I20260806 04:46:32.147641 17771 heartbeater.cc:347] Connected to a master server at 127.7.113.254:34831
I20260806 04:46:32.147936 17771 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:32.148551 17771 heartbeater.cc:511] Master 127.7.113.254:34831 requested a full tablet report, sending...
I20260806 04:46:32.150761 17582 ts_manager.cc:194] Registered new tserver with Master: a8d34f6ffbfb473697f8ea94b74642db (127.7.113.193:46481)
W20260806 04:46:32.468766 17775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:32.469054 17775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:32.469220 17775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:32.476130 17775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:32.476254 17775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:32.476433 17775 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:46:32.485288 17775 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:35917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:34831
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:32.486476 17775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:32.488119 17775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:32.500557 17780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:32.500589 17781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:32.501317 17783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:32.501598 17775 server_base.cc:1034] running on GCE node
I20260806 04:46:32.502188 17775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:32.503041 17775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:32.504307 17775 hybrid_clock.cc:648] HybridClock initialized: now 1785991592504189 us; error 68 us; skew 500 ppm
I20260806 04:46:32.504613 17775 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:46:32.506765 17775 webserver.cc:460] Webserver started at http://127.7.113.194:38939/ using document root <none> and password file <none>
I20260806 04:46:32.507436 17775 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:32.507568 17775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:32.507905 17775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:32.510632 17775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "deb916f038ce430fa5f36da8470ab278"
format_stamp: "Formatted at 2026-08-06 04:46:32 on dist-test-slave-0b58"
server_key: "107e3a8363de220a44c6cb26e1e8e4d6"
server_key_iv: "8bc6d92c71c8c92b9f11980101035ac0"
server_key_version: "encryptionkey@0"
I20260806 04:46:32.511415 17775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "deb916f038ce430fa5f36da8470ab278"
format_stamp: "Formatted at 2026-08-06 04:46:32 on dist-test-slave-0b58"
server_key: "107e3a8363de220a44c6cb26e1e8e4d6"
server_key_iv: "8bc6d92c71c8c92b9f11980101035ac0"
server_key_version: "encryptionkey@0"
I20260806 04:46:32.516407 17775 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 04:46:32.519558 17789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:32.520805 17775 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 04:46:32.520972 17775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "deb916f038ce430fa5f36da8470ab278"
format_stamp: "Formatted at 2026-08-06 04:46:32 on dist-test-slave-0b58"
server_key: "107e3a8363de220a44c6cb26e1e8e4d6"
server_key_iv: "8bc6d92c71c8c92b9f11980101035ac0"
server_key_version: "encryptionkey@0"
I20260806 04:46:32.521179 17775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:32.526602 17775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:32.527345 17775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:32.527619 17775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:32.528553 17775 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:32.529845 17775 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:32.529964 17775 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:32.530100 17775 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:32.530193 17775 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:32.562083 17775 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:37557
I20260806 04:46:32.562168 17903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:37557 every 8 connection(s)
I20260806 04:46:32.563443 17775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:46:32.569679 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 17775
I20260806 04:46:32.569854 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:46:32.570393 7623 external_mini_cluster.cc:1428] Setting key 3a5410a949f408206eece10ccbc2cefc
I20260806 04:46:32.571636 17773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:32.565994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:36967 (local address 127.7.113.254:34831)
0806 04:46:32.566183 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:32.566204 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:32.567542 (+ 1338us) server_negotiation.cc:407] Connection header received
0806 04:46:32.569274 (+ 1732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:32.569280 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:32.569374 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:32.569487 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:32.570880 (+ 1393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:32.570884 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:32.570888 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:46:32.570903 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:32.570934 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:46:32.570946 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:32.571084 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:32.571265 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 04:46:32.571347 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 04:46:32.572656 17906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:32.566529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:34831 (local address 127.7.113.194:36967)
0806 04:46:32.567383 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:32.567424 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:32.569012 (+ 1588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:32.569700 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:32.569707 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:32.569840 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:32.570588 (+ 748us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:46:32.570590 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:32.570625 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:46:32.570705 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:32.571037 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:32.571048 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:32.571059 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 04:46:32.571358 (+ 299us) client_negotiation.cc:240] Negotiation successful
0806 04:46:32.571584 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":267,"threads_started":1}
I20260806 04:46:32.573130 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:34831
--builtin_ntp_servers=127.7.113.212:35917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 04:46:32.573982 17904 heartbeater.cc:347] Connected to a master server at 127.7.113.254:34831
I20260806 04:46:32.574283 17904 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:32.574961 17904 heartbeater.cc:511] Master 127.7.113.254:34831 requested a full tablet report, sending...
I20260806 04:46:32.576412 17582 ts_manager.cc:194] Registered new tserver with Master: deb916f038ce430fa5f36da8470ab278 (127.7.113.194:37557)
W20260806 04:46:32.899343 17907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:32.899639 17907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:32.899806 17907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:32.906929 17907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:32.907053 17907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:32.907224 17907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:46:32.916320 17907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:35917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:34831
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:32.917550 17907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:32.919348 17907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:32.932250 17913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:32.932278 17915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:32.932310 17912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:32.933032 17907 server_base.cc:1034] running on GCE node
I20260806 04:46:32.933518 17907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:32.934348 17907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:32.935575 17907 hybrid_clock.cc:648] HybridClock initialized: now 1785991592935519 us; error 46 us; skew 500 ppm
I20260806 04:46:32.935885 17907 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:46:32.941259 17907 webserver.cc:460] Webserver started at http://127.7.113.195:37961/ using document root <none> and password file <none>
I20260806 04:46:32.941936 17907 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:32.942065 17907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:32.942445 17907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:32.945266 17907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "4eed274ec57949ccbe56ffe2f4c99804"
format_stamp: "Formatted at 2026-08-06 04:46:32 on dist-test-slave-0b58"
server_key: "af577e2e669f530079c30838f3df32e7"
server_key_iv: "5fe23feabf4b5e168800368fef5929dc"
server_key_version: "encryptionkey@0"
I20260806 04:46:32.946115 17907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "4eed274ec57949ccbe56ffe2f4c99804"
format_stamp: "Formatted at 2026-08-06 04:46:32 on dist-test-slave-0b58"
server_key: "af577e2e669f530079c30838f3df32e7"
server_key_iv: "5fe23feabf4b5e168800368fef5929dc"
server_key_version: "encryptionkey@0"
I20260806 04:46:32.951056 17907 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 04:46:32.954463 17921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:32.955637 17907 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 04:46:32.955812 17907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "4eed274ec57949ccbe56ffe2f4c99804"
format_stamp: "Formatted at 2026-08-06 04:46:32 on dist-test-slave-0b58"
server_key: "af577e2e669f530079c30838f3df32e7"
server_key_iv: "5fe23feabf4b5e168800368fef5929dc"
server_key_version: "encryptionkey@0"
I20260806 04:46:32.956032 17907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:32.961560 17907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:32.962347 17907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:32.962617 17907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:32.963474 17907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:32.964829 17907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:32.964963 17907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:32.965083 17907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:32.965169 17907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:32.998286 17907 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:43367
I20260806 04:46:32.998342 18034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:43367 every 8 connection(s)
I20260806 04:46:32.999572 17907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:46:33.000733 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 17907
I20260806 04:46:33.000921 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:46:33.001493 7623 external_mini_cluster.cc:1428] Setting key 857d54044cb5792a53e92212d9f518cd
I20260806 04:46:33.008139 17773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:33.002300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:46249 (local address 127.7.113.254:34831)
0806 04:46:33.002527 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:33.002533 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:33.004118 (+ 1585us) server_negotiation.cc:407] Connection header received
0806 04:46:33.005998 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:33.006003 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:33.006077 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:33.006196 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:33.007402 (+ 1206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:33.007407 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:33.007411 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:46:33.007429 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:33.007468 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:46:33.007479 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:33.007588 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:33.007811 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 04:46:33.007877 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 04:46:33.009025 18037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:33.002984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:34831 (local address 127.7.113.195:46249)
0806 04:46:33.003985 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:33.004020 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:33.005754 (+ 1734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:33.006425 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:33.006433 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:33.006515 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:33.007111 (+ 596us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:46:33.007113 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:33.007148 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:46:33.007227 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:33.007579 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:33.007588 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:33.007597 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 04:46:33.007882 (+ 285us) client_negotiation.cc:240] Negotiation successful
0806 04:46:33.008109 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":308,"threads_started":1}
I20260806 04:46:33.010169 18035 heartbeater.cc:347] Connected to a master server at 127.7.113.254:34831
I20260806 04:46:33.010450 18035 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:33.010957 18035 heartbeater.cc:511] Master 127.7.113.254:34831 requested a full tablet report, sending...
I20260806 04:46:33.012204 17582 ts_manager.cc:194] Registered new tserver with Master: 4eed274ec57949ccbe56ffe2f4c99804 (127.7.113.195:43367)
I20260806 04:46:33.016764 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 04:46:33.022708 17773 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:46:33.021150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48610 (local address 127.7.113.254:34831)
0806 04:46:33.021302 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:33.021306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:33.021811 (+ 505us) server_negotiation.cc:407] Connection header received
0806 04:46:33.022004 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:33.022009 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:33.022058 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:33.022158 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:33.022535 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48610: BlockingRecv error: recv got EOF from 127.0.0.1:48610 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 04:46:33.023869 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 17642
I20260806 04:46:33.027285 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:33.024778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60772 (local address 127.7.113.193:46481)
0806 04:46:33.025307 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:33.025313 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:33.025336 (+ 23us) server_negotiation.cc:407] Connection header received
0806 04:46:33.025430 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:33.025441 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:33.025671 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:33.025804 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:33.026665 (+ 861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:33.026671 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:33.026681 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:46:33.026697 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:33.026734 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:46:33.026747 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:33.026855 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:33.026957 (+ 102us) server_negotiation.cc:299] Negotiation successful
0806 04:46:33.027059 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":259,"threads_started":1}
I20260806 04:46:33.028542 17766 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:33.110096 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 17642
I20260806 04:46:33.128031 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 17775
I20260806 04:46:33.131346 18046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:33.128941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58962 (local address 127.7.113.194:37557)
0806 04:46:33.129483 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:33.129490 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:33.129517 (+ 27us) server_negotiation.cc:407] Connection header received
0806 04:46:33.129580 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:33.129586 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:33.129789 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:33.129911 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:33.130759 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:33.130766 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:33.130777 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:46:33.130791 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:33.130837 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:46:33.130855 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:33.130955 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:33.131034 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 04:46:33.131116 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":250,"threads_started":1}
I20260806 04:46:33.132550 17899 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:33.212585 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 17775
I20260806 04:46:33.230999 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 17907
I20260806 04:46:33.234861 18048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:33.231911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36656 (local address 127.7.113.195:43367)
0806 04:46:33.232533 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:33.232540 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:33.232570 (+ 30us) server_negotiation.cc:407] Connection header received
0806 04:46:33.232630 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:33.232637 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:33.232845 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:33.233010 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:33.234106 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:33.234112 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:33.234122 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:46:33.234133 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:33.234173 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:46:33.234189 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:33.234379 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:33.234463 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 04:46:33.234579 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":263,"threads_started":1}
I20260806 04:46:33.236014 18030 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:33.316373 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 17907
I20260806 04:46:33.335695 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 17551
I20260806 04:46:33.337092 17612 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:33.438977 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 17551
2026-08-06T04:46:33Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2316 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:46:33 dist-test-slave-0b58 krb5kdc[18053](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:46:33 dist-test-slave-0b58 krb5kdc[18053](info): set up 2 sockets
Aug 06 04:46:33 dist-test-slave-0b58 krb5kdc[18053](info): commencing operation
krb5kdc: starting...
W20260806 04:46:34.559422 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.005s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:46:34 dist-test-slave-0b58 krb5kdc[18053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:46:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:46:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:46:34.817857 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:46185
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:42801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:46185
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:46:35.147713 18066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:35.147989 18066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:35.148114 18066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:35.156139 18066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:46:35.156244 18066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:35.156363 18066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:35.156452 18066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:46:35.156533 18066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:46:35.166230 18066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:42801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:46185
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:46185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:35.167472 18066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:35.168792 18066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:35.180576 18074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:35.180619 18072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:35.180619 18071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:35.181671 18066 server_base.cc:1034] running on GCE node
I20260806 04:46:35.182386 18066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:35.183661 18066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:35.184895 18066 hybrid_clock.cc:648] HybridClock initialized: now 1785991595184844 us; error 33 us; skew 500 ppm
I20260806 04:46:35.185230 18066 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:35 dist-test-slave-0b58 krb5kdc[18053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991595, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:35.188234 18066 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:46:35.189632 18066 webserver.cc:460] Webserver started at http://127.7.113.254:41347/ using document root <none> and password file <none>
I20260806 04:46:35.190308 18066 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:35.190425 18066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:35.190670 18066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:35.193472 18066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "7fa8f7849c59455f91674ebce8b6979d"
format_stamp: "Formatted at 2026-08-06 04:46:35 on dist-test-slave-0b58"
server_key: "b02609f4e28ce0717e5b61a3914f1cf7"
server_key_iv: "292d0735534ec1446e84644d14237b3e"
server_key_version: "encryptionkey@0"
I20260806 04:46:35.194156 18066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "7fa8f7849c59455f91674ebce8b6979d"
format_stamp: "Formatted at 2026-08-06 04:46:35 on dist-test-slave-0b58"
server_key: "b02609f4e28ce0717e5b61a3914f1cf7"
server_key_iv: "292d0735534ec1446e84644d14237b3e"
server_key_version: "encryptionkey@0"
I20260806 04:46:35.198958 18066 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260806 04:46:35.202217 18083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:35.203598 18066 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:46:35.203797 18066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "7fa8f7849c59455f91674ebce8b6979d"
format_stamp: "Formatted at 2026-08-06 04:46:35 on dist-test-slave-0b58"
server_key: "b02609f4e28ce0717e5b61a3914f1cf7"
server_key_iv: "292d0735534ec1446e84644d14237b3e"
server_key_version: "encryptionkey@0"
I20260806 04:46:35.203991 18066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:35.221429 18066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:35.225368 18066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:35.225661 18066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:35.243806 18066 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:46185
I20260806 04:46:35.243848 18134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:46185 every 8 connection(s)
I20260806 04:46:35.245175 18066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:46:35.248731 18135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:35.251442 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 18066
I20260806 04:46:35.251652 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:46:35.252518 7623 external_mini_cluster.cc:1428] Setting key 9a0c23dec8a6ca5b54714b89bb6536dd
I20260806 04:46:35.261540 18135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d: Bootstrap starting.
I20260806 04:46:35.265304 18135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:35.266623 18135 log.cc:824] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d: Log is configured to *not* fsync() on all Append() calls
Aug 06 04:46:35 dist-test-slave-0b58 krb5kdc[18053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:46:35.269591 18135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d: No bootstrap required, opened a new log
I20260806 04:46:35.275862 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:35.254559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47810 (local address 127.7.113.254:46185)
0806 04:46:35.255328 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:35.255338 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:35.255377 (+ 39us) server_negotiation.cc:407] Connection header received
0806 04:46:35.257220 (+ 1843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:35.257241 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:35.257589 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:35.257900 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:35.259744 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:35.261074 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:35.262881 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:35.263540 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:35.263662 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:35.268733 (+ 5071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:35.268740 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:35.268754 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:35.268794 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:35.271867 (+ 3073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:35.272652 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:35.272662 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:35.272672 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:35.272836 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:35.273239 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:35.273244 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:35.273248 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:35.273762 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:35.274129 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:35.274533 (+ 404us) server_negotiation.cc:299] Negotiation successful
0806 04:46:35.274936 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":362,"threads_started":1}
I20260806 04:46:35.277364 18135 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fa8f7849c59455f91674ebce8b6979d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 46185 } }
I20260806 04:46:35.277722 18135 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:35.277844 18135 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa8f7849c59455f91674ebce8b6979d, State: Initialized, Role: FOLLOWER
I20260806 04:46:35.278362 18135 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fa8f7849c59455f91674ebce8b6979d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 46185 } }
I20260806 04:46:35.278617 18135 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:46:35.278764 18135 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:46:35.278918 18135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:35.281261 18135 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fa8f7849c59455f91674ebce8b6979d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 46185 } }
I20260806 04:46:35.281678 18135 leader_election.cc:302] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7fa8f7849c59455f91674ebce8b6979d; no voters:
I20260806 04:46:35.282176 18135 leader_election.cc:288] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:46:35.282256 18140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:46:35.282984 18140 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [term 1 LEADER]: Becoming Leader. State: Replica: 7fa8f7849c59455f91674ebce8b6979d, State: Running, Role: LEADER
I20260806 04:46:35.283504 18140 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fa8f7849c59455f91674ebce8b6979d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 46185 } }
I20260806 04:46:35.284149 18135 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:46:35.286230 18141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7fa8f7849c59455f91674ebce8b6979d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fa8f7849c59455f91674ebce8b6979d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 46185 } } }
I20260806 04:46:35.286336 18142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7fa8f7849c59455f91674ebce8b6979d. Latest consensus state: current_term: 1 leader_uuid: "7fa8f7849c59455f91674ebce8b6979d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fa8f7849c59455f91674ebce8b6979d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 46185 } } }
I20260806 04:46:35.286665 18141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [sys.catalog]: This master's current role is: LEADER
I20260806 04:46:35.286681 18142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d [sys.catalog]: This master's current role is: LEADER
I20260806 04:46:35.287454 18147 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:46:35.293222 18147 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:46:35.302225 18147 catalog_manager.cc:1347] Generated new cluster ID: 6e05749e0cfa4fa0b9381658516ddf63
I20260806 04:46:35.302330 18147 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:46:35.325485 18147 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:46:35.327246 18147 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:46:35.340498 18147 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d: Generated new TSK 0
I20260806 04:46:35.341298 18147 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:46:35.415843 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:46185
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:42801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:46:35.743407 18161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:35.743646 18161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:35.743814 18161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:35.750887 18161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:35.751010 18161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:35.751189 18161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:46:35.760473 18161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:42801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:46185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:35.761612 18161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:35.762933 18161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:35.775671 18167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:35.775856 18169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:35.776377 18166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:35.776618 18161 server_base.cc:1034] running on GCE node
I20260806 04:46:35.777230 18161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:35.778069 18161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:35.779289 18161 hybrid_clock.cc:648] HybridClock initialized: now 1785991595779252 us; error 50 us; skew 500 ppm
I20260806 04:46:35.779582 18161 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:35 dist-test-slave-0b58 krb5kdc[18053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991595, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:35.782657 18161 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:46:35.784042 18161 webserver.cc:460] Webserver started at http://127.7.113.193:46457/ using document root <none> and password file <none>
I20260806 04:46:35.784751 18161 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:35.784853 18161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:35.785183 18161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:35.788005 18161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "1d160f725c254b7b8c7a89db5b0237e2"
format_stamp: "Formatted at 2026-08-06 04:46:35 on dist-test-slave-0b58"
server_key: "d90d21bf1cee4d21f985c125fa4e80a7"
server_key_iv: "6c288e2a2be0fb6b1837ba39e0335baa"
server_key_version: "encryptionkey@0"
I20260806 04:46:35.788785 18161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "1d160f725c254b7b8c7a89db5b0237e2"
format_stamp: "Formatted at 2026-08-06 04:46:35 on dist-test-slave-0b58"
server_key: "d90d21bf1cee4d21f985c125fa4e80a7"
server_key_iv: "6c288e2a2be0fb6b1837ba39e0335baa"
server_key_version: "encryptionkey@0"
I20260806 04:46:35.793640 18161 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:46:35.796945 18176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:35.798235 18161 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:46:35.798354 18161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "1d160f725c254b7b8c7a89db5b0237e2"
format_stamp: "Formatted at 2026-08-06 04:46:35 on dist-test-slave-0b58"
server_key: "d90d21bf1cee4d21f985c125fa4e80a7"
server_key_iv: "6c288e2a2be0fb6b1837ba39e0335baa"
server_key_version: "encryptionkey@0"
I20260806 04:46:35.798497 18161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:35.827032 18161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:35.831204 18161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:35.831456 18161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:35.832436 18161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:35.833698 18161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:35.833770 18161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:35.833861 18161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:35.833905 18161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:35.866794 18161 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:39249
I20260806 04:46:35.866834 18291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:39249 every 8 connection(s)
I20260806 04:46:35.868074 18161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:46:35.870437 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 18161
I20260806 04:46:35.870677 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:46:35.871469 7623 external_mini_cluster.cc:1428] Setting key f3270b9536c4670bd3afeb0fd064aa8d
Aug 06 04:46:35 dist-test-slave-0b58 krb5kdc[18053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991595, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:46:35.888383 18294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:35.870580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:56161 (local address 127.7.113.254:46185)
0806 04:46:35.871115 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:35.871123 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:35.872073 (+ 950us) server_negotiation.cc:407] Connection header received
0806 04:46:35.874107 (+ 2034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:35.874112 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:35.874199 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:35.874324 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:35.875717 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:35.876482 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:35.878062 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:35.878471 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:35.878607 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:35.881960 (+ 3353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:35.881964 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:35.881967 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:35.881998 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:35.885144 (+ 3146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:35.885862 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:35.885870 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:35.885877 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:35.886028 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:35.886425 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:35.886433 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:35.886439 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:35.886809 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:35.886961 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:35.887601 (+ 640us) server_negotiation.cc:299] Negotiation successful
0806 04:46:35.887876 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":266,"threads_started":1}
I20260806 04:46:35.888918 18295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:35.871113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:46185 (local address 127.7.113.193:56161)
0806 04:46:35.871889 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:35.871940 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:35.873850 (+ 1910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:35.874542 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:35.874550 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:35.875032 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:35.875549 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:35.875566 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:35.876649 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:35.876653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:35.877910 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:35.877923 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:35.878699 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:35.878706 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:35.878939 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:35.879603 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:35.879629 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:35.881752 (+ 2123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:35.885269 (+ 3517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:35.885275 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:35.885286 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:35.885749 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:35.886136 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:35.886149 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:35.886151 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:35.886322 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:35.886928 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:35.886933 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:35.887222 (+ 289us) client_negotiation.cc:769] Sending connection context
0806 04:46:35.887444 (+ 222us) client_negotiation.cc:240] Negotiation successful
0806 04:46:35.887805 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":347,"threads_started":1}
I20260806 04:46:35.890409 18292 heartbeater.cc:347] Connected to a master server at 127.7.113.254:46185
I20260806 04:46:35.890717 18292 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:35.891413 18292 heartbeater.cc:511] Master 127.7.113.254:46185 requested a full tablet report, sending...
I20260806 04:46:35.893611 18100 ts_manager.cc:194] Registered new tserver with Master: 1d160f725c254b7b8c7a89db5b0237e2 (127.7.113.193:39249)
I20260806 04:46:35.895121 18100 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:56161
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:46:35.933455 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:46185
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:42801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:46:36.259708 18298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:36.260020 18298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:36.260154 18298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:36.269851 18298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:36.269964 18298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:36.270071 18298 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:46:36.279238 18298 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:42801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:46185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:36.280336 18298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:36.281543 18298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:36.294353 18303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:36.294392 18304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:36.294399 18306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:36.295110 18298 server_base.cc:1034] running on GCE node
I20260806 04:46:36.295713 18298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:36.296815 18298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:36.298012 18298 hybrid_clock.cc:648] HybridClock initialized: now 1785991596297946 us; error 54 us; skew 500 ppm
I20260806 04:46:36.298318 18298 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:36 dist-test-slave-0b58 krb5kdc[18053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991596, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:36.301462 18298 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:46:36.302778 18298 webserver.cc:460] Webserver started at http://127.7.113.194:46543/ using document root <none> and password file <none>
I20260806 04:46:36.303365 18298 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:36.303462 18298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:36.303692 18298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:36.306466 18298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "b269ee68be5742feb784f1d41f38197a"
format_stamp: "Formatted at 2026-08-06 04:46:36 on dist-test-slave-0b58"
server_key: "5f3b3f13e1ff1646565213695febcaf5"
server_key_iv: "83a1a8a790f67db23eb8e54a10949267"
server_key_version: "encryptionkey@0"
I20260806 04:46:36.307304 18298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "b269ee68be5742feb784f1d41f38197a"
format_stamp: "Formatted at 2026-08-06 04:46:36 on dist-test-slave-0b58"
server_key: "5f3b3f13e1ff1646565213695febcaf5"
server_key_iv: "83a1a8a790f67db23eb8e54a10949267"
server_key_version: "encryptionkey@0"
I20260806 04:46:36.312012 18298 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260806 04:46:36.315189 18313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:36.316504 18298 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:46:36.316658 18298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "b269ee68be5742feb784f1d41f38197a"
format_stamp: "Formatted at 2026-08-06 04:46:36 on dist-test-slave-0b58"
server_key: "5f3b3f13e1ff1646565213695febcaf5"
server_key_iv: "83a1a8a790f67db23eb8e54a10949267"
server_key_version: "encryptionkey@0"
I20260806 04:46:36.316854 18298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:36.327966 18298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:36.332013 18298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:36.332397 18298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:36.333225 18298 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:36.334398 18298 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:36.334470 18298 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:36.334633 18298 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:36.334686 18298 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:36.366999 18298 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:35597
I20260806 04:46:36.367045 18425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:35597 every 8 connection(s)
I20260806 04:46:36.368216 18298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:46:36.377804 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 18298
I20260806 04:46:36.377990 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:46:36.378537 7623 external_mini_cluster.cc:1428] Setting key 75111539cbd53c6c7c78394375c1e0df
Aug 06 04:46:36 dist-test-slave-0b58 krb5kdc[18053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991596, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:46:36.388671 18294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:36.370738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:57639 (local address 127.7.113.254:46185)
0806 04:46:36.370945 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:36.370951 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:36.372004 (+ 1053us) server_negotiation.cc:407] Connection header received
0806 04:46:36.373678 (+ 1674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:36.373683 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:36.373748 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:36.373831 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:36.375261 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.375940 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.377460 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.378163 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.378286 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:36.381735 (+ 3449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:36.381745 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:36.381753 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:36.381795 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:36.385460 (+ 3665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:36.386149 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:36.386157 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:36.386163 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:36.386317 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:36.386712 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:36.386719 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:36.386724 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:36.387085 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:36.387235 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:36.387928 (+ 693us) server_negotiation.cc:299] Negotiation successful
0806 04:46:36.388187 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 04:46:36.389256 18428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:36.371123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:46185 (local address 127.7.113.194:57639)
0806 04:46:36.371851 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:36.371894 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:36.373449 (+ 1555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:36.374020 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:36.374027 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:36.374492 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:36.375022 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:36.375038 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.376058 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.376061 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:36.377328 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:36.377340 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.378352 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.378356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:36.378541 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:36.379283 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:36.379312 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:36.381519 (+ 2207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:36.385604 (+ 4085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:36.385611 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:36.385620 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:36.386013 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:36.386428 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:36.386431 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:36.386433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:36.386598 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:36.387202 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:36.387207 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:36.387493 (+ 286us) client_negotiation.cc:769] Sending connection context
0806 04:46:36.387787 (+ 294us) client_negotiation.cc:240] Negotiation successful
0806 04:46:36.388130 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":272,"threads_started":1}
I20260806 04:46:36.390870 18426 heartbeater.cc:347] Connected to a master server at 127.7.113.254:46185
I20260806 04:46:36.391185 18426 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:36.391996 18426 heartbeater.cc:511] Master 127.7.113.254:46185 requested a full tablet report, sending...
I20260806 04:46:36.393602 18100 ts_manager.cc:194] Registered new tserver with Master: b269ee68be5742feb784f1d41f38197a (127.7.113.194:35597)
I20260806 04:46:36.394428 18100 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:57639
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:46:36.440062 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:46185
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:42801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:46:36.766172 18432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:46:36.766499 18432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:46:36.766670 18432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:46:36.773805 18432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:46:36.773962 18432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:46:36.774093 18432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:46:36.784670 18432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:42801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:46185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:46:36.786077 18432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:46:36.787323 18432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:46:36.800081 18437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:36.800164 18438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:46:36.800113 18440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:46:36.801306 18432 server_base.cc:1034] running on GCE node
I20260806 04:46:36.801910 18432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:46:36.802747 18432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:46:36.803980 18432 hybrid_clock.cc:648] HybridClock initialized: now 1785991596803922 us; error 53 us; skew 500 ppm
I20260806 04:46:36.804405 18432 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:46:36 dist-test-slave-0b58 krb5kdc[18053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991596, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:46:36.807467 18432 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:46:36.808985 18432 webserver.cc:460] Webserver started at http://127.7.113.195:45671/ using document root <none> and password file <none>
I20260806 04:46:36.809621 18432 fs_manager.cc:359] Metadata directory not provided
I20260806 04:46:36.809772 18432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:46:36.810062 18432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:46:36.812996 18432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "447db2fa271e4f9da68a6c99f3106d30"
format_stamp: "Formatted at 2026-08-06 04:46:36 on dist-test-slave-0b58"
server_key: "89abcc1e0b5d88f3fa0e76c91ad616a9"
server_key_iv: "d14f48f635faaace206d69e280884c37"
server_key_version: "encryptionkey@0"
I20260806 04:46:36.813758 18432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "447db2fa271e4f9da68a6c99f3106d30"
format_stamp: "Formatted at 2026-08-06 04:46:36 on dist-test-slave-0b58"
server_key: "89abcc1e0b5d88f3fa0e76c91ad616a9"
server_key_iv: "d14f48f635faaace206d69e280884c37"
server_key_version: "encryptionkey@0"
I20260806 04:46:36.818699 18432 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:46:36.822239 18447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:36.823469 18432 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:46:36.823630 18432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "447db2fa271e4f9da68a6c99f3106d30"
format_stamp: "Formatted at 2026-08-06 04:46:36 on dist-test-slave-0b58"
server_key: "89abcc1e0b5d88f3fa0e76c91ad616a9"
server_key_iv: "d14f48f635faaace206d69e280884c37"
server_key_version: "encryptionkey@0"
I20260806 04:46:36.823817 18432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:46:36.841085 18432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:46:36.844712 18432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:46:36.845070 18432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:46:36.845920 18432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:46:36.847112 18432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:46:36.847183 18432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:36.847265 18432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:46:36.847307 18432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:46:36.879503 18432 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:41191
I20260806 04:46:36.879537 18562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:41191 every 8 connection(s)
I20260806 04:46:36.880751 18432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:46:36.885780 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 18432
I20260806 04:46:36.885947 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:46:36.886413 7623 external_mini_cluster.cc:1428] Setting key a381e6342177a2d9d0245ce330fc3c83
Aug 06 04:46:36 dist-test-slave-0b58 krb5kdc[18053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991596, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:46:36.897887 18292 heartbeater.cc:503] Master 127.7.113.254:46185 was elected leader, sending a full tablet report...
I20260806 04:46:36.900987 18294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:36.883217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:38451 (local address 127.7.113.254:46185)
0806 04:46:36.883395 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:36.883400 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:36.884655 (+ 1255us) server_negotiation.cc:407] Connection header received
0806 04:46:36.886645 (+ 1990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:36.886652 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:36.886757 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:36.886865 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:36.888621 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.889657 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.891189 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.891570 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.891663 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:36.894982 (+ 3319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:36.894987 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:36.894990 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:36.895022 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:36.897667 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:36.898465 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:36.898471 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:36.898474 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:36.898650 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:36.899069 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:36.899074 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:36.899077 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:36.899414 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:36.899586 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:36.900377 (+ 791us) server_negotiation.cc:299] Negotiation successful
0806 04:46:36.900611 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 04:46:36.901993 18566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:36.883655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:46185 (local address 127.7.113.195:38451)
0806 04:46:36.884446 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:36.884482 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:36.886311 (+ 1829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:36.887156 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:36.887167 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:36.887748 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:46:36.888470 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:36.888491 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.889799 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.889803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:36.891065 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:36.891076 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.891760 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.891764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:36.891950 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:36.892668 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:46:36.892711 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:46:36.894784 (+ 2073us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:46:36.897824 (+ 3040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:36.897833 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:36.897848 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:36.898332 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:36.898767 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:46:36.898770 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:46:36.898772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:46:36.898945 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:46:36.899561 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:46:36.899568 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:46:36.899992 (+ 424us) client_negotiation.cc:769] Sending connection context
0806 04:46:36.900277 (+ 285us) client_negotiation.cc:240] Negotiation successful
0806 04:46:36.900804 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":304,"threads_started":1}
I20260806 04:46:36.903303 18563 heartbeater.cc:347] Connected to a master server at 127.7.113.254:46185
I20260806 04:46:36.903633 18563 heartbeater.cc:464] Registering TS with master...
I20260806 04:46:36.904409 18563 heartbeater.cc:511] Master 127.7.113.254:46185 requested a full tablet report, sending...
I20260806 04:46:36.905684 18100 ts_manager.cc:194] Registered new tserver with Master: 447db2fa271e4f9da68a6c99f3106d30 (127.7.113.195:41191)
I20260806 04:46:36.906436 18100 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:38451
I20260806 04:46:36.913821 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:46:36.929989 18294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:36.918050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47826 (local address 127.7.113.254:46185)
0806 04:46:36.918263 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:36.918271 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:36.918613 (+ 342us) server_negotiation.cc:407] Connection header received
0806 04:46:36.918728 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:36.918731 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:36.918794 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:36.918866 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:36.920186 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.921047 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.922407 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.922824 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.922912 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:36.925012 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:36.925017 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:36.925020 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:36.925061 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:36.927676 (+ 2615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:36.928323 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:36.928327 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:36.928329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:36.928453 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:36.928802 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:36.928805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:36.928807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:36.929086 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:36.929266 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:36.929519 (+ 253us) server_negotiation.cc:299] Negotiation successful
0806 04:46:36.929660 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 04:46:36.933696 18100 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47826:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:46:36.940317 18100 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:46:36.963646 18576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:36.951690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:35597 (local address 127.0.0.1:54558)
0806 04:46:36.952360 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:36.952409 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:36.952579 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:36.953417 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:36.953427 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:36.953484 (+ 57us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:46:36.953965 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:36.953981 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.956739 (+ 2758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.956748 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:36.959847 (+ 3099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:36.959866 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.962442 (+ 2576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.962451 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:36.962774 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:36.962849 (+ 75us) client_negotiation.cc:769] Sending connection context
0806 04:46:36.962973 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 04:46:36.963198 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"spinlock_wait_cycles":896,"thread_start_us":388,"threads_started":1}
I20260806 04:46:36.964845 18577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:36.952219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54558 (local address 127.7.113.194:35597)
0806 04:46:36.952785 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:36.952791 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:36.952813 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:46:36.952906 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:36.952915 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:36.953156 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:36.954213 (+ 1057us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:46:36.954538 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.956557 (+ 2019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.960108 (+ 3551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.962146 (+ 2038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.964102 (+ 1956us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:36.964246 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:36.964369 (+ 123us) server_negotiation.cc:299] Negotiation successful
0806 04:46:36.964555 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":331,"threads_started":1}
I20260806 04:46:36.968575 18361 tablet_service.cc:1467] Processing CreateTablet for tablet 5c0d551c33ee452687693b1c7e20eef6 (DEFAULT_TABLE table=test-table [id=5d2bdcd36d554ac3b8647743d2762b57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:36.970124 18361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c0d551c33ee452687693b1c7e20eef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:36.970923 18579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:36.953174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35698 (local address 127.7.113.193:39249)
0806 04:46:36.963818 (+ 10644us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:36.963831 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:36.963866 (+ 35us) server_negotiation.cc:407] Connection header received
0806 04:46:36.963979 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:36.963989 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:36.964310 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:36.964517 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:46:36.965238 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.966621 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.968160 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.969592 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.969732 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:36.969967 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:36.970412 (+ 445us) server_negotiation.cc:299] Negotiation successful
0806 04:46:36.970599 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10435,"thread_start_us":10229,"threads_started":1}
I20260806 04:46:36.970933 18578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:36.952859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39249 (local address 127.0.0.1:35698)
0806 04:46:36.953349 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:36.953369 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:36.953476 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:36.964758 (+ 11282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:36.964761 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:36.964780 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:46:36.965080 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:36.965090 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.966749 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.966755 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:36.967991 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:36.968002 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.970065 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.970073 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:36.970236 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:36.970267 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 04:46:36.970368 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 04:46:36.970506 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"spinlock_wait_cycles":4864,"thread_start_us":246,"threads_started":1}
I20260806 04:46:36.973649 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:36.953424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:41191 (local address 127.0.0.1:40832)
0806 04:46:36.962124 (+ 8700us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:36.962152 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:36.962298 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:36.965994 (+ 3696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:36.965998 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:36.966026 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:46:36.966464 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:36.966476 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.968648 (+ 2172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.968653 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:36.971054 (+ 2401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:36.971072 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.972838 (+ 1766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.972844 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:36.973018 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:36.973076 (+ 58us) client_negotiation.cc:769] Sending connection context
0806 04:46:36.973189 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 04:46:36.973305 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8523,"thread_start_us":8975,"threads_started":1}
I20260806 04:46:36.974361 18581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:36.954019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40832 (local address 127.7.113.195:41191)
0806 04:46:36.964790 (+ 10771us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:36.964800 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:36.964858 (+ 58us) server_negotiation.cc:407] Connection header received
0806 04:46:36.965556 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:36.965570 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:36.965787 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:36.966669 (+ 882us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:46:36.966937 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.968492 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.971239 (+ 2747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:36.972640 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:36.972774 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:36.972998 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:36.973866 (+ 868us) server_negotiation.cc:299] Negotiation successful
0806 04:46:36.974026 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10597,"thread_start_us":10425,"threads_started":1}
I20260806 04:46:36.974902 18225 tablet_service.cc:1467] Processing CreateTablet for tablet 5c0d551c33ee452687693b1c7e20eef6 (DEFAULT_TABLE table=test-table [id=5d2bdcd36d554ac3b8647743d2762b57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:36.976083 18225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c0d551c33ee452687693b1c7e20eef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:36.977836 18497 tablet_service.cc:1467] Processing CreateTablet for tablet 5c0d551c33ee452687693b1c7e20eef6 (DEFAULT_TABLE table=test-table [id=5d2bdcd36d554ac3b8647743d2762b57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:46:36.979135 18497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c0d551c33ee452687693b1c7e20eef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:46:36.984923 18582 tablet_bootstrap.cc:492] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a: Bootstrap starting.
I20260806 04:46:36.988360 18583 tablet_bootstrap.cc:492] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2: Bootstrap starting.
I20260806 04:46:36.988570 18582 tablet_bootstrap.cc:654] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:36.989773 18582 log.cc:824] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a: Log is configured to *not* fsync() on all Append() calls
I20260806 04:46:36.992230 18583 tablet_bootstrap.cc:654] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:36.992311 18585 tablet_bootstrap.cc:492] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30: Bootstrap starting.
I20260806 04:46:36.993541 18583 log.cc:824] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2: Log is configured to *not* fsync() on all Append() calls
I20260806 04:46:36.993569 18582 tablet_bootstrap.cc:492] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a: No bootstrap required, opened a new log
I20260806 04:46:36.993842 18582 ts_tablet_manager.cc:1397] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 04:46:36.995841 18585 tablet_bootstrap.cc:654] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30: Neither blocks nor log segments found. Creating new log.
I20260806 04:46:36.996994 18585 log.cc:824] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30: Log is configured to *not* fsync() on all Append() calls
I20260806 04:46:36.999935 18585 tablet_bootstrap.cc:492] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30: No bootstrap required, opened a new log
I20260806 04:46:36.999953 18583 tablet_bootstrap.cc:492] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2: No bootstrap required, opened a new log
I20260806 04:46:37.000200 18583 ts_tablet_manager.cc:1397] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260806 04:46:37.000200 18585 ts_tablet_manager.cc:1397] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260806 04:46:37.002959 18582 raft_consensus.cc:348] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b269ee68be5742feb784f1d41f38197a" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35597 } } peers { permanent_uuid: "1d160f725c254b7b8c7a89db5b0237e2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39249 } } peers { permanent_uuid: "447db2fa271e4f9da68a6c99f3106d30" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41191 } }
I20260806 04:46:37.003328 18582 raft_consensus.cc:374] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:37.003453 18582 raft_consensus.cc:729] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b269ee68be5742feb784f1d41f38197a, State: Initialized, Role: FOLLOWER
I20260806 04:46:37.004048 18582 consensus_queue.cc:260] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b269ee68be5742feb784f1d41f38197a" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35597 } } peers { permanent_uuid: "1d160f725c254b7b8c7a89db5b0237e2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39249 } } peers { permanent_uuid: "447db2fa271e4f9da68a6c99f3106d30" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41191 } }
I20260806 04:46:37.005147 18426 heartbeater.cc:503] Master 127.7.113.254:46185 was elected leader, sending a full tablet report...
I20260806 04:46:37.005798 18582 ts_tablet_manager.cc:1428] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a: Time spent starting tablet: real 0.012s user 0.006s sys 0.005s
I20260806 04:46:37.010921 18583 raft_consensus.cc:348] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b269ee68be5742feb784f1d41f38197a" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35597 } } peers { permanent_uuid: "1d160f725c254b7b8c7a89db5b0237e2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39249 } } peers { permanent_uuid: "447db2fa271e4f9da68a6c99f3106d30" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41191 } }
I20260806 04:46:37.010927 18585 raft_consensus.cc:348] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b269ee68be5742feb784f1d41f38197a" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35597 } } peers { permanent_uuid: "1d160f725c254b7b8c7a89db5b0237e2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39249 } } peers { permanent_uuid: "447db2fa271e4f9da68a6c99f3106d30" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41191 } }
I20260806 04:46:37.011334 18585 raft_consensus.cc:374] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:37.011324 18583 raft_consensus.cc:374] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:46:37.011442 18585 raft_consensus.cc:729] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 447db2fa271e4f9da68a6c99f3106d30, State: Initialized, Role: FOLLOWER
I20260806 04:46:37.011435 18583 raft_consensus.cc:729] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d160f725c254b7b8c7a89db5b0237e2, State: Initialized, Role: FOLLOWER
I20260806 04:46:37.012015 18583 consensus_queue.cc:260] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b269ee68be5742feb784f1d41f38197a" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35597 } } peers { permanent_uuid: "1d160f725c254b7b8c7a89db5b0237e2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39249 } } peers { permanent_uuid: "447db2fa271e4f9da68a6c99f3106d30" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41191 } }
I20260806 04:46:37.012043 18585 consensus_queue.cc:260] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b269ee68be5742feb784f1d41f38197a" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35597 } } peers { permanent_uuid: "1d160f725c254b7b8c7a89db5b0237e2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39249 } } peers { permanent_uuid: "447db2fa271e4f9da68a6c99f3106d30" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41191 } }
I20260806 04:46:37.013497 18563 heartbeater.cc:503] Master 127.7.113.254:46185 was elected leader, sending a full tablet report...
I20260806 04:46:37.013761 18583 ts_tablet_manager.cc:1428] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2: Time spent starting tablet: real 0.013s user 0.004s sys 0.009s
I20260806 04:46:37.014093 18585 ts_tablet_manager.cc:1428] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30: Time spent starting tablet: real 0.014s user 0.011s sys 0.002s
I20260806 04:46:37.113664 18588 raft_consensus.cc:482] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:46:37.114055 18588 raft_consensus.cc:504] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b269ee68be5742feb784f1d41f38197a" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35597 } } peers { permanent_uuid: "1d160f725c254b7b8c7a89db5b0237e2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39249 } } peers { permanent_uuid: "447db2fa271e4f9da68a6c99f3106d30" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41191 } }
I20260806 04:46:37.115931 18588 leader_election.cc:288] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d160f725c254b7b8c7a89db5b0237e2 (127.7.113.193:39249), 447db2fa271e4f9da68a6c99f3106d30 (127.7.113.195:41191)
W20260806 04:46:37.120355 18427 tablet.cc:2369] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:46:37.120498 18293 tablet.cc:2369] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:46:37.123610 18579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.116224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:39563 (local address 127.7.113.193:39249)
0806 04:46:37.116479 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:37.116483 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:37.117146 (+ 663us) server_negotiation.cc:407] Connection header received
0806 04:46:37.117233 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:37.117239 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:37.117322 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:37.117428 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:46:37.118120 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.119078 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.121627 (+ 2549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.122653 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.122779 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:37.122831 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:37.123229 (+ 398us) server_negotiation.cc:299] Negotiation successful
0806 04:46:37.123360 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 04:46:37.123718 18591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.116109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39249 (local address 127.7.113.194:39563)
0806 04:46:37.116847 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:37.116868 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:37.117009 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:37.117472 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:37.117479 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:37.117508 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:46:37.117958 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:37.117972 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.119220 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.119226 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:37.121476 (+ 2250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:37.121488 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.122864 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.122872 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:37.123049 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:37.123091 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 04:46:37.123188 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 04:46:37.123291 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"mutex_wait_us":19,"spinlock_wait_cycles":22912,"thread_start_us":381,"threads_started":1}
I20260806 04:46:37.124070 18592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.116931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:41191 (local address 127.7.113.194:52763)
0806 04:46:37.117588 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:37.117601 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 04:46:37.117711 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:46:37.118095 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:46:37.118099 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:46:37.118122 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:46:37.118527 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:37.118538 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.119728 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.119735 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:37.121810 (+ 2075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:46:37.121825 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.123119 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.123123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:46:37.123332 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:37.123363 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 04:46:37.123458 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 04:46:37.123574 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":25,"thread_start_us":368,"threads_started":1}
I20260806 04:46:37.124102 18581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.117043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:52763 (local address 127.7.113.195:41191)
0806 04:46:37.117231 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:37.117237 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:37.117697 (+ 460us) server_negotiation.cc:407] Connection header received
0806 04:46:37.117831 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:37.117838 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:37.117949 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:37.118050 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:46:37.118672 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.119602 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.121961 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.122924 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.123083 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:37.123157 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:37.123502 (+ 345us) server_negotiation.cc:299] Negotiation successful
0806 04:46:37.123634 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 04:46:37.124920 18246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c0d551c33ee452687693b1c7e20eef6" candidate_uuid: "b269ee68be5742feb784f1d41f38197a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d160f725c254b7b8c7a89db5b0237e2" is_pre_election: true
I20260806 04:46:37.125249 18518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c0d551c33ee452687693b1c7e20eef6" candidate_uuid: "b269ee68be5742feb784f1d41f38197a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447db2fa271e4f9da68a6c99f3106d30" is_pre_election: true
I20260806 04:46:37.125526 18246 raft_consensus.cc:2454] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b269ee68be5742feb784f1d41f38197a in term 0.
I20260806 04:46:37.125797 18518 raft_consensus.cc:2454] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b269ee68be5742feb784f1d41f38197a in term 0.
I20260806 04:46:37.126267 18314 leader_election.cc:302] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d160f725c254b7b8c7a89db5b0237e2, b269ee68be5742feb784f1d41f38197a; no voters:
I20260806 04:46:37.126626 18588 raft_consensus.cc:2781] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:46:37.126772 18588 raft_consensus.cc:482] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:46:37.126899 18588 raft_consensus.cc:3037] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:37.129177 18588 raft_consensus.cc:504] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b269ee68be5742feb784f1d41f38197a" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35597 } } peers { permanent_uuid: "1d160f725c254b7b8c7a89db5b0237e2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39249 } } peers { permanent_uuid: "447db2fa271e4f9da68a6c99f3106d30" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41191 } }
I20260806 04:46:37.129702 18588 leader_election.cc:288] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [CANDIDATE]: Term 1 election: Requested vote from peers 1d160f725c254b7b8c7a89db5b0237e2 (127.7.113.193:39249), 447db2fa271e4f9da68a6c99f3106d30 (127.7.113.195:41191)
I20260806 04:46:37.130170 18246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c0d551c33ee452687693b1c7e20eef6" candidate_uuid: "b269ee68be5742feb784f1d41f38197a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d160f725c254b7b8c7a89db5b0237e2"
I20260806 04:46:37.130257 18518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c0d551c33ee452687693b1c7e20eef6" candidate_uuid: "b269ee68be5742feb784f1d41f38197a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447db2fa271e4f9da68a6c99f3106d30"
I20260806 04:46:37.130366 18246 raft_consensus.cc:3037] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:46:37.130499 18518 raft_consensus.cc:3037] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30 [term 0 FOLLOWER]: Advancing to term 1
W20260806 04:46:37.132332 18564 tablet.cc:2369] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:46:37.132730 18246 raft_consensus.cc:2454] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b269ee68be5742feb784f1d41f38197a in term 1.
I20260806 04:46:37.133039 18518 raft_consensus.cc:2454] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b269ee68be5742feb784f1d41f38197a in term 1.
I20260806 04:46:37.133121 18314 leader_election.cc:302] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d160f725c254b7b8c7a89db5b0237e2, b269ee68be5742feb784f1d41f38197a; no voters:
I20260806 04:46:37.133607 18588 raft_consensus.cc:2781] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:46:37.134027 18588 raft_consensus.cc:686] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [term 1 LEADER]: Becoming Leader. State: Replica: b269ee68be5742feb784f1d41f38197a, State: Running, Role: LEADER
I20260806 04:46:37.134456 18588 consensus_queue.cc:237] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b269ee68be5742feb784f1d41f38197a" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35597 } } peers { permanent_uuid: "1d160f725c254b7b8c7a89db5b0237e2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39249 } } peers { permanent_uuid: "447db2fa271e4f9da68a6c99f3106d30" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41191 } }
I20260806 04:46:37.139097 18099 catalog_manager.cc:5495] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a reported cstate change: term changed from 0 to 1, leader changed from <none> to b269ee68be5742feb784f1d41f38197a (127.7.113.194). New cstate: current_term: 1 leader_uuid: "b269ee68be5742feb784f1d41f38197a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b269ee68be5742feb784f1d41f38197a" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d160f725c254b7b8c7a89db5b0237e2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "447db2fa271e4f9da68a6c99f3106d30" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41191 } health_report { overall_health: UNKNOWN } } }
I20260806 04:46:37.162266 18577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.157705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54560 (local address 127.7.113.194:35597)
0806 04:46:37.157884 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:37.157888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:37.157903 (+ 15us) server_negotiation.cc:407] Connection header received
0806 04:46:37.157974 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:37.157977 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:37.158043 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:37.158157 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:46:37.158479 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.159160 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.160486 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.160877 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.160967 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:37.161355 (+ 388us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:46:37.161793 (+ 438us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:46:37.161901 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:37.161998 (+ 97us) server_negotiation.cc:299] Negotiation successful
0806 04:46:37.162058 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 04:46:37.170334 18518 raft_consensus.cc:1261] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30 [term 1 FOLLOWER]: Refusing update from remote peer b269ee68be5742feb784f1d41f38197a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:46:37.170334 18246 raft_consensus.cc:1261] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2 [term 1 FOLLOWER]: Refusing update from remote peer b269ee68be5742feb784f1d41f38197a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:46:37.171241 18593 consensus_queue.cc:1035] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [LEADER]: Connected to new peer: Peer: permanent_uuid: "447db2fa271e4f9da68a6c99f3106d30" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:46:37.171614 18588 consensus_queue.cc:1035] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d160f725c254b7b8c7a89db5b0237e2" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:46:37.184365 18597 mvcc.cc:205] Tried to move back new op lower bound from 7315421581999865856 to 7315421581866119168. Current Snapshot: MvccSnapshot[applied={T|T < 7315421581999865856}]
I20260806 04:46:37.195760 18100 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:46:37.196040 18100 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:46:37.199524 18100 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7fa8f7849c59455f91674ebce8b6979d: Sending DeleteTablet for 3 replicas of tablet 5c0d551c33ee452687693b1c7e20eef6
I20260806 04:46:37.200593 18361 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c0d551c33ee452687693b1c7e20eef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:37 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:54558
I20260806 04:46:37.200841 18225 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c0d551c33ee452687693b1c7e20eef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:37 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:35698
I20260806 04:46:37.201512 18497 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c0d551c33ee452687693b1c7e20eef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:46:37 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:40832
I20260806 04:46:37.202142 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 18161
I20260806 04:46:37.205729 18608 tablet_replica.cc:330] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30: stopping tablet replica
I20260806 04:46:37.208364 18608 raft_consensus.cc:2229] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:46:37.209066 18608 raft_consensus.cc:2258] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:37.210469 18606 tablet_replica.cc:330] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a: stopping tablet replica
I20260806 04:46:37.210913 18606 raft_consensus.cc:2229] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:46:37.211663 18606 raft_consensus.cc:2258] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:37.212905 18608 ts_tablet_manager.cc:1905] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:46:37.213774 18606 ts_tablet_manager.cc:1905] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 04:46:37 dist-test-slave-0b58 krb5kdc[18053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:46:37.221618 18607 tablet_replica.cc:330] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2: stopping tablet replica
I20260806 04:46:37.222163 18607 raft_consensus.cc:2229] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:46:37.222841 18607 raft_consensus.cc:2258] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:46:37.222864 18606 ts_tablet_manager.cc:1918] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:46:37.223017 18606 log.cc:1196] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/5c0d551c33ee452687693b1c7e20eef6
I20260806 04:46:37.223667 18606 ts_tablet_manager.cc:1939] T 5c0d551c33ee452687693b1c7e20eef6 P b269ee68be5742feb784f1d41f38197a: Deleting consensus metadata
I20260806 04:46:37.224964 18607 ts_tablet_manager.cc:1905] T 5c0d551c33ee452687693b1c7e20eef6 P 1d160f725c254b7b8c7a89db5b0237e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:46:37.225486 18608 ts_tablet_manager.cc:1918] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:46:37.225494 18084 catalog_manager.cc:4841] TS b269ee68be5742feb784f1d41f38197a (127.7.113.194:35597): tablet 5c0d551c33ee452687693b1c7e20eef6 (table test-table [id=5d2bdcd36d554ac3b8647743d2762b57]) successfully deleted
I20260806 04:46:37.226423 18579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.203360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35706 (local address 127.7.113.193:39249)
0806 04:46:37.203570 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:37.203579 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:37.205008 (+ 1429us) server_negotiation.cc:407] Connection header received
0806 04:46:37.205219 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:37.205226 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:37.205325 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:37.205449 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:37.209633 (+ 4184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.210786 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.212646 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.213278 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.213387 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:37.218679 (+ 5292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:37.218695 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:37.218713 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:37.218752 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:37.222965 (+ 4213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:37.223793 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:37.223801 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:37.223804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:37.223981 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:37.224469 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:37.224475 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:37.224478 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:37.224890 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:37.225184 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:37.225766 (+ 582us) server_negotiation.cc:299] Negotiation successful
0806 04:46:37.225987 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 04:46:37.227816 18287 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:37.230229 18608 log.cc:1196] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/5c0d551c33ee452687693b1c7e20eef6
I20260806 04:46:37.230901 18608 ts_tablet_manager.cc:1939] T 5c0d551c33ee452687693b1c7e20eef6 P 447db2fa271e4f9da68a6c99f3106d30: Deleting consensus metadata
I20260806 04:46:37.232936 18084 catalog_manager.cc:4841] TS 447db2fa271e4f9da68a6c99f3106d30 (127.7.113.195:41191): tablet 5c0d551c33ee452687693b1c7e20eef6 (table test-table [id=5d2bdcd36d554ac3b8647743d2762b57]) successfully deleted
I20260806 04:46:37.349453 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 18161
W20260806 04:46:37.377651 18084 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.113.193:39249 (error 108)
I20260806 04:46:37.378968 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 18298
I20260806 04:46:37.380986 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.380462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39249 (local address 127.0.0.1:35720)
0806 04:46:37.380700 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:37.380814 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
W20260806 04:46:37.381333 18084 catalog_manager.cc:4584] TS 1d160f725c254b7b8c7a89db5b0237e2 (127.7.113.193:39249): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5c0d551c33ee452687693b1c7e20eef6: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39249: connect: Connection refused (error 111)
Aug 06 04:46:37 dist-test-slave-0b58 krb5kdc[18053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:46:37.403225 18577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.380041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54562 (local address 127.7.113.194:35597)
0806 04:46:37.380207 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:37.380213 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:37.381907 (+ 1694us) server_negotiation.cc:407] Connection header received
0806 04:46:37.382166 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:37.382172 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:37.382267 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:37.382348 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:37.384172 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.385789 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.387977 (+ 2188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.388839 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.388944 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:37.394891 (+ 5947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:37.394905 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:37.394924 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:37.394976 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:37.399436 (+ 4460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:37.400468 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:37.400479 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:37.400485 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:37.400668 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:37.401113 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:37.401119 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:37.401124 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:37.401598 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:37.401925 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:37.402239 (+ 314us) server_negotiation.cc:299] Negotiation successful
0806 04:46:37.402794 (+ 555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 04:46:37.403946 18421 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:37.434813 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.434390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39249 (local address 127.0.0.1:35724)
0806 04:46:37.434588 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:37.434674 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 04:46:37.435784 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.435464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39249 (local address 127.0.0.1:35740)
0806 04:46:37.435600 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:37.435675 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 04:46:37.496151 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.495722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39249 (local address 127.0.0.1:35756)
0806 04:46:37.495928 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:37.496010 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 04:46:37.497157 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.496865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39249 (local address 127.0.0.1:35770)
0806 04:46:37.496989 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:37.497055 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 04:46:37.527961 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 18298
I20260806 04:46:37.548650 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 18432
Aug 06 04:46:37 dist-test-slave-0b58 krb5kdc[18053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:46:37.562327 18581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.549409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40842 (local address 127.7.113.195:41191)
0806 04:46:37.549581 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 04:46:37.549585 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:46:37.549620 (+ 35us) server_negotiation.cc:407] Connection header received
0806 04:46:37.549778 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:46:37.549781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:46:37.549841 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:46:37.549945 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:46:37.551154 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.551867 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.553065 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:46:37.553426 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:46:37.553516 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:46:37.557446 (+ 3930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:46:37.557459 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:46:37.557473 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:46:37.557501 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:46:37.560101 (+ 2600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:37.560719 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:37.560726 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:37.560729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:37.560862 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:46:37.561164 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:46:37.561167 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:46:37.561169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:46:37.561491 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:46:37.561695 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0806 04:46:37.561900 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 04:46:37.562077 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 04:46:37.562938 18558 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:37.577636 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.577207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39249 (local address 127.0.0.1:35778)
0806 04:46:37.577389 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:37.577470 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 04:46:37.578637 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.578276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39249 (local address 127.0.0.1:35780)
0806 04:46:37.578472 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:37.578537 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260806 04:46:37.650347 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 18432
I20260806 04:46:37.668203 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 18066
I20260806 04:46:37.669414 18130 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:46:37.779812 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:46:37.779317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39249 (local address 127.0.0.1:35792)
0806 04:46:37.779537 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 04:46:37.779646 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 04:46:37.779961 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 18066
2026-08-06T04:46:37Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4339 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:46:37 dist-test-slave-0b58 krb5kdc[18618](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:46:37 dist-test-slave-0b58 krb5kdc[18618](info): set up 2 sockets
Aug 06 04:46:37 dist-test-slave-0b58 krb5kdc[18618](info): commencing operation
krb5kdc: starting...
W20260806 04:46:38.911185 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:46:39 dist-test-slave-0b58 krb5kdc[18618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:46:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:46:39Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.7.113.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.7.113.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/rangeradmin_127.7.113.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/rangeradmin_127.7.113.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.7.113.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.7.113.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/rangerlookup_127.7.113.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/rangerlookup_127.7.113.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.113.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.7.113.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/HTTP_127.7.113.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/HTTP_127.7.113.212@KRBTEST.COM.keytab.
I20260806 04:46:39.283596 7623 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskTmaHtW/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/postgres -l logfile start
2026-08-06 04:46:41.798 UTC [18649] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 04:46:41.798 UTC [18649] LOG: listening on IPv4 address "127.7.113.212", port 35607
2026-08-06 04:46:41.802 UTC [18649] LOG: listening on Unix socket "/tmp/.s.PGSQL.35607"
2026-08-06 04:46:41.823 UTC [18652] LOG: database system was shut down at 2026-08-06 04:46:40 UTC
2026-08-06 04:46:41.827 UTC [18649] LOG: database system is ready to accept connections
I20260806 04:46:42.811103 7623 mini_postgres.cc:96] Postgres bound to 35607
2026-08-06 04:46:42.835 UTC [18660] FATAL: database "slave" does not exist
127.7.113.212:35607 - accepting connections
I20260806 04:46:42.835981 7623 mini_ranger.cc:161] Starting Ranger...
I20260806 04:46:42.865465 7623 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 04:46:43.338519 7623 mini_ranger.cc:87] Created ranger Postgres database
I20260806 04:46:43.338696 7623 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-admin
2026-08-06 04:46:43,668 [I] DB FLAVOR :POSTGRES
2026-08-06 04:46:43,669 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 04:46:43,669 [I] Checking connection..
2026-08-06 04:46:43,669 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 04:46:43,919 [I] Checking connection passed.
2026-08-06 04:46:43,920 [I] --------- Verifying version history table ---------
2026-08-06 04:46:43,920 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 04:46:44,166 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 04:46:44,167 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 04:46:44,407 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 04:46:44,407 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 04:46:44,407 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 04:46:44.643 UTC [18724] WARNING: there is no transaction in progress
2026-08-06 04:46:44,649 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 04:46:44,649 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 04:46:44,890 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 04:46:44,891 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 04:46:44,891 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 04:46:45,110 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 04:46:45,364 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-0b58.c.gcp-upstream.internal','N') ;"
2026-08-06 04:46:45,602 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 04:46:45,836 [I] Table x_portal_user does not exist in database ranger
2026-08-06 04:46:45,836 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 04:46:46,091 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 04:46:46,091 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 04:46:46,340 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 04:46:46,590 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 04:46:46,590 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 04:46:47.487 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.502 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.517 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.532 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.551 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.570 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.633 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.639 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.652 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.661 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.671 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.684 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.693 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.699 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.706 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:47.712 UTC [18835] WARNING: there is no transaction in progress
2026-08-06 04:46:48,340 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 04:46:48,341 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 04:46:48,595 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 04:46:48,596 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 04:46:48,821 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 04:46:48,821 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 04:46:49,046 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 04:46:49,046 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 04:46:49,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 04:46:49,518 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-0b58.c.gcp-upstream.internal';"
2026-08-06 04:46:49,757 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 04:46:49,757 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 04:46:49,996 [I] DB_PATCHES have already been applied
I20260806 04:46:50.001817 7623 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-admin:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskTmaHtW/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 04:46:50.001935 7623 mini_ranger.cc:193] Using host: 127.7.113.212
I20260806 04:46:50.022696 7623 mini_ranger.cc:227] Ranger admin URL: http://127.7.113.212:58683
Aug 06, 2026 4:46:50 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 4:46:50 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 4:46:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 4:46:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 4:46:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 4:46:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 4:46:50 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 04:46:51.162473 7623 mini_ranger.cc:160] Time spent starting Ranger: real 8.326s user 0.004s sys 0.053s
Aug 06, 2026 4:47:11 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 4:47:11 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 06, 2026 4:47:11 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 4:47:11 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 4:47:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 4:47:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 4:47:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 4:47:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 4:47:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 4:47:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 4:47:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 4:47:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 4:47:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 4:47:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 4:47:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 4:47:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 4:47:11 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 4:47:12 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 04:47:13.068866 7623 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.7.113.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.7.113.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/rangerkms_127.7.113.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/rangerkms_127.7.113.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.113.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.7.113.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.113.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/HTTP_127.7.113.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.113.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/HTTP_127.7.113.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 04:47:13 dist-test-slave-0b58 krb5kdc[18618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991633, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 04:47:13.275235 7623 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 04:47:13.301442 7623 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 04:47:14.179565 7623 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 04:47:14.179726 7623 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-kms
I20260806 04:47:14.179890 7623 mini_ranger_kms.cc:227] Using postgres at 127.7.113.212:35607
2026-08-06 04:47:14,779 [I] DB FLAVOR :POSTGRES
2026-08-06 04:47:14,779 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 04:47:14,779 [I] Checking connection
2026-08-06 04:47:14,779 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 04:47:15,067 [I] connection success
2026-08-06 04:47:15,068 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 04:47:15,068 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 04:47:15,068 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 04:47:15,359 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 04:47:15,360 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 04:47:15,360 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 04:47:15,360 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:35607/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 04:47:15,634 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 04:47:16.086019 7623 mini_ranger_kms.cc:310] Created kms service
I20260806 04:47:16.300860 7623 mini_ranger_kms.cc:326] Created kudu user
I20260806 04:47:16.346626 7623 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 04:47:16 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991633, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:47:16.720731 7623 mini_ranger_kms.cc:384] Added ranger policy
I20260806 04:47:16.722036 7623 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-kms:/tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 04:47:16.722110 7623 mini_ranger_kms.cc:240] Using host: 127.7.113.212
I20260806 04:47:16.747323 7623 mini_ranger_kms.cc:276] Ranger KMS PID: 19019
I20260806 04:47:16.747532 7623 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.7.113.212:53591
Aug 06, 2026 4:47:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 4:47:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 4:47:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 4:47:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 4:47:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 4:47:18 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260806 04:47:19.121735 7623 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.847s user 0.115s sys 0.522s
I20260806 04:47:19.122128 7623 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 04:47:19.122372 7623 mini_ranger_kms.cc:401] 127.7.113.212:53591/kms/v1/keys
Aug 06 04:47:19 dist-test-slave-0b58 krb5kdc[18618](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785991639, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.113.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 04:47:19 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991639, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.113.212@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
Aug 06 04:47:19 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991639, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.113.212@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
Aug 06 04:47:22 dist-test-slave-0b58 krb5kdc[18618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:47:22.334059 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:39483
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:34791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:39483
--ranger_config_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.113.212:53591/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:47:22.670248 19071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:47:22.670609 19071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:47:22.670765 19071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:47:22.677856 19071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:47:22.677995 19071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:47:22.678092 19071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:47:22.678187 19071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:47:22.678269 19071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:47:22.688398 19071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:34791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/wal
--ranger_kms_url=127.7.113.212:53591/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:39483
--ranger_config_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:39483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:47:22.689687 19071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:47:22.690961 19071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:47:22.703907 19077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:47:22.703994 19076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:47:22.704749 19079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:47:22.705387 19071 server_base.cc:1034] running on GCE node
I20260806 04:47:22.706317 19071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:47:22.708103 19071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:47:22.709352 19071 hybrid_clock.cc:648] HybridClock initialized: now 1785991642709295 us; error 73 us; skew 500 ppm
I20260806 04:47:22.709728 19071 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:47:22 dist-test-slave-0b58 krb5kdc[18618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991642, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:47:22.717868 19071 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:47:22.719607 19071 webserver.cc:460] Webserver started at http://127.7.113.254:46797/ using document root <none> and password file <none>
I20260806 04:47:22.720367 19071 fs_manager.cc:359] Metadata directory not provided
I20260806 04:47:22.720510 19071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:47:22.720852 19071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 04:47:22 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991642, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:47:22.779958 19071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "ed6c55afcb08402687086da97cae74e1"
format_stamp: "Formatted at 2026-08-06 04:47:22 on dist-test-slave-0b58"
server_key: "abd9546d28cddac947bc945041d78611"
server_key_iv: "2ead72e239d2a6d8b00e1597fdc513ad"
server_key_version: "kuduclusterkey@0"
I20260806 04:47:22.780884 19071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "ed6c55afcb08402687086da97cae74e1"
format_stamp: "Formatted at 2026-08-06 04:47:22 on dist-test-slave-0b58"
server_key: "abd9546d28cddac947bc945041d78611"
server_key_iv: "2ead72e239d2a6d8b00e1597fdc513ad"
server_key_version: "kuduclusterkey@0"
I20260806 04:47:22.786669 19071 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:47:22.805245 19086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:47:22.806793 19071 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:47:22.806978 19071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "ed6c55afcb08402687086da97cae74e1"
format_stamp: "Formatted at 2026-08-06 04:47:22 on dist-test-slave-0b58"
server_key: "abd9546d28cddac947bc945041d78611"
server_key_iv: "2ead72e239d2a6d8b00e1597fdc513ad"
server_key_version: "kuduclusterkey@0"
I20260806 04:47:22.807216 19071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:47:22.819093 19071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:47:22.823065 19071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:47:22.823371 19071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:47:22.843655 19071 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:39483
I20260806 04:47:22.843675 19138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:39483 every 8 connection(s)
I20260806 04:47:22.845104 19071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:47:22.847396 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 19071
I20260806 04:47:22.847595 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:47:22.848430 7623 external_mini_cluster.cc:1428] Setting key 81f37e4702e7f0e36d96be7a6bfdac3b
I20260806 04:47:22.849251 19139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:47:22.868629 19139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1: Bootstrap starting.
I20260806 04:47:22.872366 19139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1: Neither blocks nor log segments found. Creating new log.
I20260806 04:47:22.873502 19139 log.cc:824] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1: Log is configured to *not* fsync() on all Append() calls
I20260806 04:47:22.876852 19139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1: No bootstrap required, opened a new log
Aug 06 04:47:22 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:47:22.886857 19142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:22.850567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56302 (local address 127.7.113.254:39483)
0806 04:47:22.865575 (+ 15008us) server_negotiation.cc:206] Beginning negotiation
0806 04:47:22.865596 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 04:47:22.865648 (+ 52us) server_negotiation.cc:407] Connection header received
0806 04:47:22.868090 (+ 2442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:47:22.868118 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:47:22.868643 (+ 525us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:47:22.869082 (+ 439us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:47:22.870634 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:22.872748 (+ 2114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:22.874464 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:22.875322 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:22.875524 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:22.879350 (+ 3826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:47:22.879358 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:47:22.879372 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:47:22.879404 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:47:22.882735 (+ 3331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:22.883464 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:22.883471 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:22.883477 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:22.883626 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:22.884016 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:22.884022 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:22.884025 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:22.884646 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:47:22.884967 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0806 04:47:22.885409 (+ 442us) server_negotiation.cc:299] Negotiation successful
0806 04:47:22.885853 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14754,"thread_start_us":14531,"threads_started":1}
I20260806 04:47:22.887717 19139 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed6c55afcb08402687086da97cae74e1" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39483 } }
I20260806 04:47:22.888204 19139 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:47:22.888355 19139 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed6c55afcb08402687086da97cae74e1, State: Initialized, Role: FOLLOWER
I20260806 04:47:22.888999 19139 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed6c55afcb08402687086da97cae74e1" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39483 } }
I20260806 04:47:22.889307 19139 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:47:22.889460 19139 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:47:22.889639 19139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:47:22.892704 19139 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed6c55afcb08402687086da97cae74e1" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39483 } }
I20260806 04:47:22.893275 19139 leader_election.cc:302] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed6c55afcb08402687086da97cae74e1; no voters:
I20260806 04:47:22.894066 19139 leader_election.cc:288] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:47:22.894155 19144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:47:22.896167 19139 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:47:22.900956 19144 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [term 1 LEADER]: Becoming Leader. State: Replica: ed6c55afcb08402687086da97cae74e1, State: Running, Role: LEADER
I20260806 04:47:22.901480 19144 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed6c55afcb08402687086da97cae74e1" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39483 } }
I20260806 04:47:22.904079 19145 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed6c55afcb08402687086da97cae74e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed6c55afcb08402687086da97cae74e1" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39483 } } }
I20260806 04:47:22.908314 19145 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [sys.catalog]: This master's current role is: LEADER
I20260806 04:47:22.904072 19146 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed6c55afcb08402687086da97cae74e1. Latest consensus state: current_term: 1 leader_uuid: "ed6c55afcb08402687086da97cae74e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed6c55afcb08402687086da97cae74e1" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39483 } } }
I20260806 04:47:22.909144 19146 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1 [sys.catalog]: This master's current role is: LEADER
I20260806 04:47:22.916095 19151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:47:22.939253 19151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:47:22.967186 19151 catalog_manager.cc:1347] Generated new cluster ID: 31ae80cc77e748aebf720f27efc32099
I20260806 04:47:22.967308 19151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:47:22.986522 19151 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:47:22.988489 19151 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:47:22.996490 19139 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 04:47:23.016412 19151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1: Generated new TSK 0
I20260806 04:47:23.018025 19151 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:47:23.793126 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.113.212:53591/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39483
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:34791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 04:47:24 dist-test-slave-0b58 krb5kdc[18618](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785991644, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 04:47:24.225062 19184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:47:24.225512 19184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:47:24.225703 19184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:47:24.237429 19184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:47:24.237578 19184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:47:24.237823 19184 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:47:24.253549 19184 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:34791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.7.113.212:53591/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39483
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:47:24.255224 19184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:47:24.257085 19184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:47:24.282667 19194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:47:24.283596 19195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:47:24.284509 19197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:47:24.286036 19184 server_base.cc:1034] running on GCE node
I20260806 04:47:24.286791 19184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:47:24.288025 19184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:47:24.289347 19184 hybrid_clock.cc:648] HybridClock initialized: now 1785991644289222 us; error 116 us; skew 500 ppm
I20260806 04:47:24.289719 19184 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:47:24 dist-test-slave-0b58 krb5kdc[18618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991644, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:47:24.293838 19184 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:47:24.301566 19184 webserver.cc:460] Webserver started at http://127.7.113.193:34015/ using document root <none> and password file <none>
I20260806 04:47:24.302312 19184 fs_manager.cc:359] Metadata directory not provided
I20260806 04:47:24.302443 19184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:47:24.302805 19184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 04:47:24 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991644, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:47:24.320997 19184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "d8752efb8d8e4c4ba554a1d212613de9"
format_stamp: "Formatted at 2026-08-06 04:47:24 on dist-test-slave-0b58"
server_key: "66cece25170fb732e19775d9203a2a9f"
server_key_iv: "4e6ff4af17caafa1041ff31273882b5a"
server_key_version: "kuduclusterkey@0"
I20260806 04:47:24.321977 19184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "d8752efb8d8e4c4ba554a1d212613de9"
format_stamp: "Formatted at 2026-08-06 04:47:24 on dist-test-slave-0b58"
server_key: "66cece25170fb732e19775d9203a2a9f"
server_key_iv: "4e6ff4af17caafa1041ff31273882b5a"
server_key_version: "kuduclusterkey@0"
I20260806 04:47:24.327745 19184 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 04:47:24.368937 19204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:47:24.371006 19184 fs_manager.cc:725] Time spent opening block manager: real 0.020s user 0.012s sys 0.008s
I20260806 04:47:24.371340 19184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "d8752efb8d8e4c4ba554a1d212613de9"
format_stamp: "Formatted at 2026-08-06 04:47:24 on dist-test-slave-0b58"
server_key: "66cece25170fb732e19775d9203a2a9f"
server_key_iv: "4e6ff4af17caafa1041ff31273882b5a"
server_key_version: "kuduclusterkey@0"
I20260806 04:47:24.371732 19184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:47:24.427987 19184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:47:24.432968 19184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:47:24.433327 19184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:47:24.434430 19184 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:47:24.444814 19184 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:47:24.444921 19184 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:47:24.445132 19184 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:47:24.445289 19184 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:47:24.496675 19184 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:37395
I20260806 04:47:24.496754 19318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:37395 every 8 connection(s)
I20260806 04:47:24.498431 19184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:47:24.499588 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 19184
I20260806 04:47:24.499814 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:47:24.500720 7623 external_mini_cluster.cc:1428] Setting key 4ce4e40f3d259d18cbbd5ff30a1000b5
Aug 06 04:47:24 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991644, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
Aug 06 04:47:24 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991644, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:47:24.546684 19320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:24.507870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:39483 (local address 127.7.113.193:33733)
0806 04:47:24.516750 (+ 8880us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:24.516798 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 04:47:24.519150 (+ 2352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:47:24.522837 (+ 3687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:47:24.522853 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:47:24.523513 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:47:24.524323 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:24.524348 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:24.525923 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:24.525928 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:24.528112 (+ 2184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:24.528137 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:24.529418 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:24.529424 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:24.529705 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:24.531477 (+ 1772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:47:24.531508 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:47:24.537012 (+ 5504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:47:24.541262 (+ 4250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:47:24.541270 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:47:24.541288 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:47:24.541852 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:47:24.542318 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:47:24.542323 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:47:24.542327 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:47:24.542573 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:47:24.543956 (+ 1383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:47:24.543964 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:47:24.544422 (+ 458us) client_negotiation.cc:769] Sending connection context
0806 04:47:24.544726 (+ 304us) client_negotiation.cc:240] Negotiation successful
0806 04:47:24.545254 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8589,"thread_start_us":8370,"threads_started":1}
I20260806 04:47:24.547811 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:24.508498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:33733 (local address 127.7.113.254:39483)
0806 04:47:24.515755 (+ 7257us) server_negotiation.cc:206] Beginning negotiation
0806 04:47:24.515765 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:47:24.519428 (+ 3663us) server_negotiation.cc:407] Connection header received
0806 04:47:24.519487 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:47:24.519491 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:47:24.519558 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:47:24.519687 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:47:24.524531 (+ 4844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:24.525714 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:24.528344 (+ 2630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:24.528979 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:24.529070 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:24.537312 (+ 8242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:47:24.537319 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:47:24.537324 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:47:24.537367 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:47:24.541060 (+ 3693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:24.542010 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:24.542016 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:24.542020 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:24.542158 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:24.542702 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:24.542707 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:24.542710 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:24.543049 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:47:24.543883 (+ 834us) server_negotiation.cc:1035] Waiting for connection context
0806 04:47:24.547221 (+ 3338us) server_negotiation.cc:299] Negotiation successful
0806 04:47:24.547468 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7072,"thread_start_us":6951,"threads_started":1}
I20260806 04:47:24.560647 19319 heartbeater.cc:347] Connected to a master server at 127.7.113.254:39483
I20260806 04:47:24.560985 19319 heartbeater.cc:464] Registering TS with master...
I20260806 04:47:24.561879 19319 heartbeater.cc:511] Master 127.7.113.254:39483 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
I20260806 04:47:24.564533 19103 ts_manager.cc:194] Registered new tserver with Master: d8752efb8d8e4c4ba554a1d212613de9 (127.7.113.193:37395)
I20260806 04:47:24.566658 19103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:33733
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
W20260806 04:47:24.615973 7623 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.7.113.194: real 0.112s user 0.000s sys 0.024s
I20260806 04:47:24.617061 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.113.212:53591/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39483
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:34791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 04:47:24 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991644, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
W20260806 04:47:25.134935 19325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:47:25.135353 19325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:47:25.135608 19325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:47:25.146063 19325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:47:25.146328 19325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:47:25.146607 19325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:47:25.163338 19325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:34791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.7.113.212:53591/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39483
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:47:25.165453 19325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:47:25.167332 19325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:47:25.191493 19332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:47:25.192405 19333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:47:25.201418 19325 server_base.cc:1034] running on GCE node
W20260806 04:47:25.201551 19335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:47:25.202468 19325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:47:25.203728 19325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:47:25.205036 19325 hybrid_clock.cc:648] HybridClock initialized: now 1785991645204963 us; error 57 us; skew 500 ppm
I20260806 04:47:25.205456 19325 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:47:25 dist-test-slave-0b58 krb5kdc[18618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991645, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:47:25.209786 19325 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:47:25.216451 19325 webserver.cc:460] Webserver started at http://127.7.113.194:42637/ using document root <none> and password file <none>
I20260806 04:47:25.217461 19325 fs_manager.cc:359] Metadata directory not provided
I20260806 04:47:25.217607 19325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:47:25.217976 19325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 04:47:25 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991645, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:47:25.246222 19325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "56230a5cca57441d93581e0e03670316"
format_stamp: "Formatted at 2026-08-06 04:47:25 on dist-test-slave-0b58"
server_key: "9ac241d40202c7be8bd854ee32546dcc"
server_key_iv: "59b89f3b957cf144145e427b77343c44"
server_key_version: "kuduclusterkey@0"
I20260806 04:47:25.247112 19325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "56230a5cca57441d93581e0e03670316"
format_stamp: "Formatted at 2026-08-06 04:47:25 on dist-test-slave-0b58"
server_key: "9ac241d40202c7be8bd854ee32546dcc"
server_key_iv: "59b89f3b957cf144145e427b77343c44"
server_key_version: "kuduclusterkey@0"
I20260806 04:47:25.254799 19325 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.003s
I20260806 04:47:25.275003 19349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:47:25.276722 19325 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 04:47:25.276911 19325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "56230a5cca57441d93581e0e03670316"
format_stamp: "Formatted at 2026-08-06 04:47:25 on dist-test-slave-0b58"
server_key: "9ac241d40202c7be8bd854ee32546dcc"
server_key_iv: "59b89f3b957cf144145e427b77343c44"
server_key_version: "kuduclusterkey@0"
I20260806 04:47:25.277232 19325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:47:25.317549 19325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:47:25.321979 19325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:47:25.322324 19325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:47:25.323519 19325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:47:25.325194 19325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:47:25.325304 19325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:47:25.325464 19325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:47:25.325541 19325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:47:25.388613 19325 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:44743
I20260806 04:47:25.388677 19462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:44743 every 8 connection(s)
I20260806 04:47:25.389966 19325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:47:25.393177 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 19325
I20260806 04:47:25.393361 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:47:25.393898 7623 external_mini_cluster.cc:1428] Setting key b0e86bfe2828ed94a1f27ec4187e47e6
Aug 06 04:47:25 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991645, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
I20260806 04:47:25.434007 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:25.394922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:36419 (local address 127.7.113.254:39483)
0806 04:47:25.410232 (+ 15310us) server_negotiation.cc:206] Beginning negotiation
0806 04:47:25.410236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:47:25.410255 (+ 19us) server_negotiation.cc:407] Connection header received
0806 04:47:25.412777 (+ 2522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:47:25.412785 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:47:25.412892 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:47:25.413048 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:47:25.415404 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:25.416754 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:25.419365 (+ 2611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:25.420361 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:25.420496 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:25.425817 (+ 5321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:47:25.425860 (+ 43us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:47:25.425866 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:47:25.425918 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:47:25.430208 (+ 4290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:25.431116 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:25.431121 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:25.431125 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:25.431286 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:25.431795 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:25.431800 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:25.431803 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:25.432188 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:47:25.432402 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0806 04:47:25.433312 (+ 910us) server_negotiation.cc:299] Negotiation successful
0806 04:47:25.433571 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15165,"thread_start_us":15313,"threads_started":1}
I20260806 04:47:25.435124 19465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:25.394106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:39483 (local address 127.7.113.194:36419)
0806 04:47:25.409301 (+ 15195us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:25.409369 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 04:47:25.412439 (+ 3070us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:47:25.413365 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:47:25.413377 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:47:25.414193 (+ 816us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:47:25.415199 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:25.415226 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:25.416971 (+ 1745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:25.416976 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:25.419191 (+ 2215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:25.419216 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:25.420792 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:25.420800 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:25.421239 (+ 439us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:25.422243 (+ 1004us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:47:25.422277 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:47:25.425546 (+ 3269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:47:25.430365 (+ 4819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:47:25.430371 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:47:25.430385 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:47:25.430941 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:47:25.431406 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:47:25.431423 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:47:25.431425 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:47:25.431682 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:47:25.432394 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:47:25.432402 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:47:25.432839 (+ 437us) client_negotiation.cc:769] Sending connection context
0806 04:47:25.433213 (+ 374us) client_negotiation.cc:240] Negotiation successful
0806 04:47:25.433793 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14855,"thread_start_us":14612,"threads_started":1}
I20260806 04:47:25.436767 19463 heartbeater.cc:347] Connected to a master server at 127.7.113.254:39483
I20260806 04:47:25.437145 19463 heartbeater.cc:464] Registering TS with master...
I20260806 04:47:25.437996 19463 heartbeater.cc:511] Master 127.7.113.254:39483 requested a full tablet report, sending...
I20260806 04:47:25.439597 19103 ts_manager.cc:194] Registered new tserver with Master: 56230a5cca57441d93581e0e03670316 (127.7.113.194:44743)
I20260806 04:47:25.440490 19103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:36419
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:47:25.473695 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.113.212:53591/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39483
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:34791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:47:25.570427 19319 heartbeater.cc:503] Master 127.7.113.254:39483 was elected leader, sending a full tablet report...
W20260806 04:47:25.895123 19469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:47:25.895484 19469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:47:25.895648 19469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:47:25.904863 19469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:47:25.905022 19469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:47:25.905237 19469 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:47:25.917505 19469 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:34791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.7.113.212:53591/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39483
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:47:25.918807 19469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:47:25.920115 19469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:47:25.934497 19474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:47:25.934598 19475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:47:25.934525 19477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:47:25.935258 19469 server_base.cc:1034] running on GCE node
I20260806 04:47:25.935936 19469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:47:25.937078 19469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:47:25.938357 19469 hybrid_clock.cc:648] HybridClock initialized: now 1785991645938247 us; error 43 us; skew 500 ppm
I20260806 04:47:25.938755 19469 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:47:25 dist-test-slave-0b58 krb5kdc[18618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991645, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:47:25.942193 19469 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:47:25.943921 19469 webserver.cc:460] Webserver started at http://127.7.113.195:45951/ using document root <none> and password file <none>
I20260806 04:47:25.944684 19469 fs_manager.cc:359] Metadata directory not provided
I20260806 04:47:25.944839 19469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:47:25.945154 19469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 04:47:25 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991645, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:47:25.959900 19469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "3d9793be53a94141a93c18613ebacf3f"
format_stamp: "Formatted at 2026-08-06 04:47:25 on dist-test-slave-0b58"
server_key: "a666ea355c3479ec485dcdeaeb386975"
server_key_iv: "5f5a1eb96a75e632846a9ee7e4e48187"
server_key_version: "kuduclusterkey@0"
I20260806 04:47:25.960808 19469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "3d9793be53a94141a93c18613ebacf3f"
format_stamp: "Formatted at 2026-08-06 04:47:25 on dist-test-slave-0b58"
server_key: "a666ea355c3479ec485dcdeaeb386975"
server_key_iv: "5f5a1eb96a75e632846a9ee7e4e48187"
server_key_version: "kuduclusterkey@0"
I20260806 04:47:25.966249 19469 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:47:25.982393 19485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:47:25.983860 19469 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:47:25.984025 19469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "3d9793be53a94141a93c18613ebacf3f"
format_stamp: "Formatted at 2026-08-06 04:47:25 on dist-test-slave-0b58"
server_key: "a666ea355c3479ec485dcdeaeb386975"
server_key_iv: "5f5a1eb96a75e632846a9ee7e4e48187"
server_key_version: "kuduclusterkey@0"
I20260806 04:47:25.984236 19469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:47:26.009594 19469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:47:26.013530 19469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:47:26.013929 19469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:47:26.015362 19469 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:47:26.016990 19469 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:47:26.017091 19469 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:47:26.017223 19469 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:47:26.017318 19469 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:47:26.061833 19469 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:45865
I20260806 04:47:26.061923 19600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:45865 every 8 connection(s)
I20260806 04:47:26.063210 19469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:47:26.065946 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 19469
I20260806 04:47:26.066134 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:47:26.066670 7623 external_mini_cluster.cc:1428] Setting key 8c4cc01f761e53c66277e7c0c112435f
Aug 06 04:47:26 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991645, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:47:26.084555 19603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.065962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:36659 (local address 127.7.113.254:39483)
0806 04:47:26.066670 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0806 04:47:26.066675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:47:26.067747 (+ 1072us) server_negotiation.cc:407] Connection header received
0806 04:47:26.069949 (+ 2202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:47:26.069954 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:47:26.070054 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:47:26.070171 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:47:26.071776 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.072577 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.074093 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.074530 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.074656 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.078179 (+ 3523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:47:26.078185 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:47:26.078189 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:47:26.078222 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:47:26.081593 (+ 3371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:26.082516 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:26.082521 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:26.082526 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:26.082668 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:26.083114 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:26.083117 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:26.083119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:26.083408 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:47:26.083518 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 04:47:26.084077 (+ 559us) server_negotiation.cc:299] Negotiation successful
0806 04:47:26.084225 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":477,"threads_started":1}
I20260806 04:47:26.085510 19604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.066605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:39483 (local address 127.7.113.195:36659)
0806 04:47:26.067592 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:26.067632 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 04:47:26.069689 (+ 2057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:47:26.070424 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:47:26.070432 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:47:26.070881 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:47:26.071611 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:26.071629 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.072742 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.072746 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:26.073930 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:26.073949 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.074802 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.074811 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:26.075087 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.075671 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:47:26.075723 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:47:26.077967 (+ 2244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:47:26.081745 (+ 3778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:47:26.081751 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:47:26.081761 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:47:26.082383 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:47:26.082763 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:47:26.082766 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:47:26.082768 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:47:26.083019 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:47:26.083513 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:47:26.083518 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:47:26.083788 (+ 270us) client_negotiation.cc:769] Sending connection context
0806 04:47:26.084010 (+ 222us) client_negotiation.cc:240] Negotiation successful
0806 04:47:26.084447 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"thread_start_us":429,"threads_started":1}
I20260806 04:47:26.086835 19601 heartbeater.cc:347] Connected to a master server at 127.7.113.254:39483
I20260806 04:47:26.087080 19601 heartbeater.cc:464] Registering TS with master...
I20260806 04:47:26.087868 19601 heartbeater.cc:511] Master 127.7.113.254:39483 requested a full tablet report, sending...
I20260806 04:47:26.089603 19103 ts_manager.cc:194] Registered new tserver with Master: 3d9793be53a94141a93c18613ebacf3f (127.7.113.195:45865)
I20260806 04:47:26.090451 19103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:36659
I20260806 04:47:26.094388 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:47:26.112895 19603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.099420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56314 (local address 127.7.113.254:39483)
0806 04:47:26.099596 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 04:47:26.099602 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:47:26.100216 (+ 614us) server_negotiation.cc:407] Connection header received
0806 04:47:26.100464 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:47:26.100468 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:47:26.100541 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:47:26.100666 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:47:26.102319 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.103042 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.104543 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.104975 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.105111 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.107586 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:47:26.107591 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:47:26.107594 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:47:26.107624 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:47:26.110061 (+ 2437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:26.110876 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:26.110882 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:26.110887 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:26.111003 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:26.111369 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:26.111377 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:26.111380 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:26.111688 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:47:26.111958 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0806 04:47:26.112303 (+ 345us) server_negotiation.cc:299] Negotiation successful
0806 04:47:26.112522 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 04:47:26.116789 19103 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56314:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:47:26.124590 19103 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:47:26.159807 19615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.137238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:44743 (local address 127.0.0.1:60222)
0806 04:47:26.148753 (+ 11515us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:26.148769 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:47:26.148888 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:47:26.150767 (+ 1879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:47:26.150778 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:47:26.150875 (+ 97us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:47:26.151574 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:26.151610 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.153873 (+ 2263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.153878 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:26.156589 (+ 2711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:26.156604 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.158569 (+ 1965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.158576 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:26.158845 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.158883 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 04:47:26.159029 (+ 146us) client_negotiation.cc:240] Negotiation successful
0806 04:47:26.159268 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11402,"thread_start_us":11260,"threads_started":1}
I20260806 04:47:26.159852 19616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.137333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60222 (local address 127.7.113.194:44743)
0806 04:47:26.149444 (+ 12111us) server_negotiation.cc:206] Beginning negotiation
0806 04:47:26.149456 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:47:26.149491 (+ 35us) server_negotiation.cc:407] Connection header received
0806 04:47:26.149627 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:47:26.149638 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:47:26.149962 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:47:26.150187 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:47:26.152050 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.153732 (+ 1682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.156765 (+ 3033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.158175 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.158515 (+ 340us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.158776 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0806 04:47:26.159352 (+ 576us) server_negotiation.cc:299] Negotiation successful
0806 04:47:26.159533 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11901,"thread_start_us":13155,"threads_started":1}
I20260806 04:47:26.160936 19617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.137361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51862 (local address 127.7.113.195:45865)
0806 04:47:26.151785 (+ 14424us) server_negotiation.cc:206] Beginning negotiation
0806 04:47:26.151796 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:47:26.151834 (+ 38us) server_negotiation.cc:407] Connection header received
0806 04:47:26.151955 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:47:26.151962 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:47:26.152137 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:47:26.152344 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:47:26.152922 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.154671 (+ 1749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.157248 (+ 2577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.158844 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.159009 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.159235 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0806 04:47:26.159909 (+ 674us) server_negotiation.cc:299] Negotiation successful
0806 04:47:26.160117 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14222,"thread_start_us":13927,"threads_started":1}
I20260806 04:47:26.161382 19619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.149783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47904 (local address 127.7.113.193:37395)
0806 04:47:26.151089 (+ 1306us) server_negotiation.cc:206] Beginning negotiation
0806 04:47:26.151096 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:47:26.152544 (+ 1448us) server_negotiation.cc:407] Connection header received
0806 04:47:26.152653 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:47:26.152660 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:47:26.152883 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:47:26.153066 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:47:26.153857 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.155497 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.158001 (+ 2504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.159627 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.159812 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.160115 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0806 04:47:26.160800 (+ 685us) server_negotiation.cc:299] Negotiation successful
0806 04:47:26.160965 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1164,"thread_start_us":958,"threads_started":1}
I20260806 04:47:26.161698 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.136929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:45865 (local address 127.0.0.1:51862)
0806 04:47:26.148495 (+ 11566us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:26.148547 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 04:47:26.148756 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:47:26.152329 (+ 3573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:47:26.152333 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:47:26.152391 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:47:26.152751 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:26.152760 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.154836 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.154841 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:26.157065 (+ 2224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:26.157076 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.159087 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.159093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:26.159310 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.159341 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 04:47:26.159491 (+ 150us) client_negotiation.cc:240] Negotiation successful
0806 04:47:26.159621 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11218,"spinlock_wait_cycles":15104,"thread_start_us":10949,"threads_started":1}
I20260806 04:47:26.161965 19618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.149287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:37395 (local address 127.0.0.1:47904)
0806 04:47:26.152182 (+ 2895us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:26.152207 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 04:47:26.152387 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:47:26.153070 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:47:26.153076 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:47:26.153101 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:47:26.153668 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:26.153682 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.155646 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.155658 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:26.157825 (+ 2167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:26.157839 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.160321 (+ 2482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.160331 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:26.160522 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.160554 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 04:47:26.160654 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 04:47:26.160794 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2751,"spinlock_wait_cycles":1280,"thread_start_us":2600,"threads_started":1}
I20260806 04:47:26.164549 19397 tablet_service.cc:1467] Processing CreateTablet for tablet 7d2fbf92417043e38b84ef49773d4c32 (DEFAULT_TABLE table=test-table [id=75194ed6bfc04f768b7d7c0698cf148c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:47:26.164937 19534 tablet_service.cc:1467] Processing CreateTablet for tablet 7d2fbf92417043e38b84ef49773d4c32 (DEFAULT_TABLE table=test-table [id=75194ed6bfc04f768b7d7c0698cf148c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:47:26.165402 19253 tablet_service.cc:1467] Processing CreateTablet for tablet 7d2fbf92417043e38b84ef49773d4c32 (DEFAULT_TABLE table=test-table [id=75194ed6bfc04f768b7d7c0698cf148c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:47:26.166109 19397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d2fbf92417043e38b84ef49773d4c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:47:26.166365 19534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d2fbf92417043e38b84ef49773d4c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:47:26.166791 19253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d2fbf92417043e38b84ef49773d4c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:47:26.179095 19620 tablet_bootstrap.cc:492] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f: Bootstrap starting.
I20260806 04:47:26.182278 19621 tablet_bootstrap.cc:492] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316: Bootstrap starting.
I20260806 04:47:26.183353 19620 tablet_bootstrap.cc:654] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f: Neither blocks nor log segments found. Creating new log.
I20260806 04:47:26.183413 19622 tablet_bootstrap.cc:492] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9: Bootstrap starting.
I20260806 04:47:26.184672 19620 log.cc:824] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f: Log is configured to *not* fsync() on all Append() calls
I20260806 04:47:26.186488 19621 tablet_bootstrap.cc:654] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316: Neither blocks nor log segments found. Creating new log.
I20260806 04:47:26.187465 19622 tablet_bootstrap.cc:654] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9: Neither blocks nor log segments found. Creating new log.
I20260806 04:47:26.188087 19620 tablet_bootstrap.cc:492] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f: No bootstrap required, opened a new log
I20260806 04:47:26.188171 19621 log.cc:824] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316: Log is configured to *not* fsync() on all Append() calls
I20260806 04:47:26.188889 19620 ts_tablet_manager.cc:1397] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260806 04:47:26.189427 19622 log.cc:824] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9: Log is configured to *not* fsync() on all Append() calls
I20260806 04:47:26.192757 19622 tablet_bootstrap.cc:492] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9: No bootstrap required, opened a new log
I20260806 04:47:26.193073 19622 ts_tablet_manager.cc:1397] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.005s
I20260806 04:47:26.193411 19621 tablet_bootstrap.cc:492] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316: No bootstrap required, opened a new log
I20260806 04:47:26.193702 19621 ts_tablet_manager.cc:1397] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.006s
I20260806 04:47:26.200318 19620 raft_consensus.cc:348] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9793be53a94141a93c18613ebacf3f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45865 } } peers { permanent_uuid: "56230a5cca57441d93581e0e03670316" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44743 } } peers { permanent_uuid: "d8752efb8d8e4c4ba554a1d212613de9" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 37395 } }
I20260806 04:47:26.201071 19620 raft_consensus.cc:374] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:47:26.200919 19622 raft_consensus.cc:348] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9793be53a94141a93c18613ebacf3f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45865 } } peers { permanent_uuid: "56230a5cca57441d93581e0e03670316" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44743 } } peers { permanent_uuid: "d8752efb8d8e4c4ba554a1d212613de9" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 37395 } }
I20260806 04:47:26.201216 19620 raft_consensus.cc:729] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d9793be53a94141a93c18613ebacf3f, State: Initialized, Role: FOLLOWER
I20260806 04:47:26.201314 19622 raft_consensus.cc:374] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:47:26.201406 19622 raft_consensus.cc:729] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8752efb8d8e4c4ba554a1d212613de9, State: Initialized, Role: FOLLOWER
I20260806 04:47:26.202024 19622 consensus_queue.cc:260] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9793be53a94141a93c18613ebacf3f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45865 } } peers { permanent_uuid: "56230a5cca57441d93581e0e03670316" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44743 } } peers { permanent_uuid: "d8752efb8d8e4c4ba554a1d212613de9" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 37395 } }
I20260806 04:47:26.202020 19620 consensus_queue.cc:260] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9793be53a94141a93c18613ebacf3f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45865 } } peers { permanent_uuid: "56230a5cca57441d93581e0e03670316" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44743 } } peers { permanent_uuid: "d8752efb8d8e4c4ba554a1d212613de9" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 37395 } }
I20260806 04:47:26.203904 19622 ts_tablet_manager.cc:1428] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9: Time spent starting tablet: real 0.011s user 0.008s sys 0.003s
I20260806 04:47:26.205749 19621 raft_consensus.cc:348] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9793be53a94141a93c18613ebacf3f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45865 } } peers { permanent_uuid: "56230a5cca57441d93581e0e03670316" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44743 } } peers { permanent_uuid: "d8752efb8d8e4c4ba554a1d212613de9" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 37395 } }
I20260806 04:47:26.206295 19621 raft_consensus.cc:374] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:47:26.206413 19621 raft_consensus.cc:729] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56230a5cca57441d93581e0e03670316, State: Initialized, Role: FOLLOWER
I20260806 04:47:26.207005 19621 consensus_queue.cc:260] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9793be53a94141a93c18613ebacf3f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45865 } } peers { permanent_uuid: "56230a5cca57441d93581e0e03670316" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44743 } } peers { permanent_uuid: "d8752efb8d8e4c4ba554a1d212613de9" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 37395 } }
I20260806 04:47:26.207420 19601 heartbeater.cc:503] Master 127.7.113.254:39483 was elected leader, sending a full tablet report...
I20260806 04:47:26.207912 19620 ts_tablet_manager.cc:1428] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f: Time spent starting tablet: real 0.019s user 0.010s sys 0.007s
I20260806 04:47:26.209177 19463 heartbeater.cc:503] Master 127.7.113.254:39483 was elected leader, sending a full tablet report...
I20260806 04:47:26.209785 19621 ts_tablet_manager.cc:1428] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316: Time spent starting tablet: real 0.016s user 0.014s sys 0.001s
W20260806 04:47:26.269326 19322 tablet.cc:2369] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:47:26.314973 19602 tablet.cc:2369] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:47:26.316591 19626 raft_consensus.cc:482] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:47:26.316891 19626 raft_consensus.cc:504] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9793be53a94141a93c18613ebacf3f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45865 } } peers { permanent_uuid: "56230a5cca57441d93581e0e03670316" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44743 } } peers { permanent_uuid: "d8752efb8d8e4c4ba554a1d212613de9" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 37395 } }
I20260806 04:47:26.318663 19626 leader_election.cc:288] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d9793be53a94141a93c18613ebacf3f (127.7.113.195:45865), 56230a5cca57441d93581e0e03670316 (127.7.113.194:44743)
I20260806 04:47:26.326391 19616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.319373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:35129 (local address 127.7.113.194:44743)
0806 04:47:26.319597 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 04:47:26.319604 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:47:26.320457 (+ 853us) server_negotiation.cc:407] Connection header received
0806 04:47:26.320729 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:47:26.320733 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:47:26.320802 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:47:26.320901 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:47:26.321571 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.322317 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.324466 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.325346 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.325521 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.325596 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 04:47:26.325946 (+ 350us) server_negotiation.cc:299] Negotiation successful
0806 04:47:26.326072 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 04:47:26.326542 19629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.319265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:44743 (local address 127.7.113.193:35129)
0806 04:47:26.320323 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:26.320364 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 04:47:26.320554 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:47:26.320920 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:47:26.320924 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:47:26.320948 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:47:26.321378 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:26.321387 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.322448 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.322456 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:26.324271 (+ 1815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:26.324283 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.325549 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.325555 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:26.325722 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.325745 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 04:47:26.325919 (+ 174us) client_negotiation.cc:240] Negotiation successful
0806 04:47:26.326045 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":869,"mutex_wait_us":23,"thread_start_us":567,"threads_started":1}
I20260806 04:47:26.326576 19617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.319061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:36573 (local address 127.7.113.195:45865)
0806 04:47:26.319243 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 04:47:26.319247 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:47:26.320702 (+ 1455us) server_negotiation.cc:407] Connection header received
0806 04:47:26.320993 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:47:26.321000 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:47:26.321072 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:47:26.321164 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:47:26.321822 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.322561 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.324655 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.325560 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.325752 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.325826 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 04:47:26.326153 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 04:47:26.326278 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 04:47:26.326766 19630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.319597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:45865 (local address 127.7.113.193:36573)
0806 04:47:26.320578 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:26.320592 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 04:47:26.320820 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:47:26.321183 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:47:26.321187 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:47:26.321215 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:47:26.321640 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:26.321649 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.322738 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.322742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:26.324512 (+ 1770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:47:26.324524 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.325788 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.325795 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:47:26.325984 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.326007 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 04:47:26.326115 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 04:47:26.326251 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":864,"mutex_wait_us":2,"thread_start_us":560,"threads_started":1}
I20260806 04:47:26.327733 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d2fbf92417043e38b84ef49773d4c32" candidate_uuid: "d8752efb8d8e4c4ba554a1d212613de9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56230a5cca57441d93581e0e03670316" is_pre_election: true
I20260806 04:47:26.327925 19554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d2fbf92417043e38b84ef49773d4c32" candidate_uuid: "d8752efb8d8e4c4ba554a1d212613de9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d9793be53a94141a93c18613ebacf3f" is_pre_election: true
I20260806 04:47:26.328394 19417 raft_consensus.cc:2454] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8752efb8d8e4c4ba554a1d212613de9 in term 0.
I20260806 04:47:26.328585 19554 raft_consensus.cc:2454] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8752efb8d8e4c4ba554a1d212613de9 in term 0.
I20260806 04:47:26.329155 19206 leader_election.cc:302] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56230a5cca57441d93581e0e03670316, d8752efb8d8e4c4ba554a1d212613de9; no voters:
I20260806 04:47:26.329663 19626 raft_consensus.cc:2781] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:47:26.329820 19626 raft_consensus.cc:482] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:47:26.329949 19626 raft_consensus.cc:3037] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:47:26.332340 19626 raft_consensus.cc:504] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9793be53a94141a93c18613ebacf3f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45865 } } peers { permanent_uuid: "56230a5cca57441d93581e0e03670316" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44743 } } peers { permanent_uuid: "d8752efb8d8e4c4ba554a1d212613de9" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 37395 } }
I20260806 04:47:26.333034 19626 leader_election.cc:288] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [CANDIDATE]: Term 1 election: Requested vote from peers 3d9793be53a94141a93c18613ebacf3f (127.7.113.195:45865), 56230a5cca57441d93581e0e03670316 (127.7.113.194:44743)
I20260806 04:47:26.333468 19554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d2fbf92417043e38b84ef49773d4c32" candidate_uuid: "d8752efb8d8e4c4ba554a1d212613de9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d9793be53a94141a93c18613ebacf3f"
I20260806 04:47:26.333468 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d2fbf92417043e38b84ef49773d4c32" candidate_uuid: "d8752efb8d8e4c4ba554a1d212613de9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56230a5cca57441d93581e0e03670316"
I20260806 04:47:26.333649 19554 raft_consensus.cc:3037] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:47:26.333662 19417 raft_consensus.cc:3037] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:47:26.335963 19554 raft_consensus.cc:2454] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8752efb8d8e4c4ba554a1d212613de9 in term 1.
I20260806 04:47:26.336272 19417 raft_consensus.cc:2454] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8752efb8d8e4c4ba554a1d212613de9 in term 1.
I20260806 04:47:26.336406 19205 leader_election.cc:302] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d9793be53a94141a93c18613ebacf3f, d8752efb8d8e4c4ba554a1d212613de9; no voters:
I20260806 04:47:26.336762 19626 raft_consensus.cc:2781] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:47:26.337358 19626 raft_consensus.cc:686] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [term 1 LEADER]: Becoming Leader. State: Replica: d8752efb8d8e4c4ba554a1d212613de9, State: Running, Role: LEADER
I20260806 04:47:26.337797 19626 consensus_queue.cc:237] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9793be53a94141a93c18613ebacf3f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45865 } } peers { permanent_uuid: "56230a5cca57441d93581e0e03670316" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44743 } } peers { permanent_uuid: "d8752efb8d8e4c4ba554a1d212613de9" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 37395 } }
I20260806 04:47:26.342486 19103 catalog_manager.cc:5495] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8752efb8d8e4c4ba554a1d212613de9 (127.7.113.193). New cstate: current_term: 1 leader_uuid: "d8752efb8d8e4c4ba554a1d212613de9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9793be53a94141a93c18613ebacf3f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56230a5cca57441d93581e0e03670316" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8752efb8d8e4c4ba554a1d212613de9" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 37395 } health_report { overall_health: HEALTHY } } }
I20260806 04:47:26.388051 19619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.381913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47914 (local address 127.7.113.193:37395)
0806 04:47:26.382171 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0806 04:47:26.382177 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:47:26.382311 (+ 134us) server_negotiation.cc:407] Connection header received
0806 04:47:26.382548 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:47:26.382552 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:47:26.382666 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:47:26.382818 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:47:26.383227 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.384116 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.385624 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.386155 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.386311 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.386870 (+ 559us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:47:26.387340 (+ 470us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:47:26.387539 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0806 04:47:26.387589 (+ 50us) server_negotiation.cc:299] Negotiation successful
0806 04:47:26.387684 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260806 04:47:26.392575 19464 tablet.cc:2369] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:47:26.397805 19554 raft_consensus.cc:1261] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f [term 1 FOLLOWER]: Refusing update from remote peer d8752efb8d8e4c4ba554a1d212613de9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:47:26.397861 19417 raft_consensus.cc:1261] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316 [term 1 FOLLOWER]: Refusing update from remote peer d8752efb8d8e4c4ba554a1d212613de9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:47:26.398777 19631 consensus_queue.cc:1035] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56230a5cca57441d93581e0e03670316" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:47:26.399273 19626 consensus_queue.cc:1035] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d9793be53a94141a93c18613ebacf3f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:47:26.410491 19636 mvcc.cc:205] Tried to move back new op lower bound from 7315421783634694144 to 7315421783403220992. Current Snapshot: MvccSnapshot[applied={T|T < 7315421783634694144}]
I20260806 04:47:26.413122 19635 mvcc.cc:205] Tried to move back new op lower bound from 7315421783634694144 to 7315421783403220992. Current Snapshot: MvccSnapshot[applied={T|T < 7315421783634694144}]
I20260806 04:47:26.432003 19103 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:47:26.432317 19103 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:47:26.435989 19103 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ed6c55afcb08402687086da97cae74e1: Sending DeleteTablet for 3 replicas of tablet 7d2fbf92417043e38b84ef49773d4c32
I20260806 04:47:26.437237 19534 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d2fbf92417043e38b84ef49773d4c32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:47:26 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:51862
I20260806 04:47:26.437570 19397 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d2fbf92417043e38b84ef49773d4c32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:47:26 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:60222
I20260806 04:47:26.437762 19253 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d2fbf92417043e38b84ef49773d4c32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:47:26 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:47904
I20260806 04:47:26.440366 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 19184
I20260806 04:47:26.449141 19645 tablet_replica.cc:330] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316: stopping tablet replica
I20260806 04:47:26.449375 19646 tablet_replica.cc:330] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9: stopping tablet replica
I20260806 04:47:26.450001 19646 raft_consensus.cc:2229] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:47:26.450384 19645 raft_consensus.cc:2229] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:47:26.450892 19646 raft_consensus.cc:2258] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:47:26.451536 19645 raft_consensus.cc:2258] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:47:26.451996 19644 tablet_replica.cc:330] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f: stopping tablet replica
I20260806 04:47:26.452435 19644 raft_consensus.cc:2229] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:47:26.452914 19644 raft_consensus.cc:2258] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:47:26.453241 19646 ts_tablet_manager.cc:1905] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:47:26.453969 19645 ts_tablet_manager.cc:1905] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:47:26.454918 19644 ts_tablet_manager.cc:1905] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 04:47:26 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:47:26.462095 19644 ts_tablet_manager.cc:1918] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:47:26.462095 19645 ts_tablet_manager.cc:1918] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:47:26.462255 19644 log.cc:1196] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/7d2fbf92417043e38b84ef49773d4c32
I20260806 04:47:26.462255 19645 log.cc:1196] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/7d2fbf92417043e38b84ef49773d4c32
I20260806 04:47:26.462779 19645 ts_tablet_manager.cc:1939] T 7d2fbf92417043e38b84ef49773d4c32 P 56230a5cca57441d93581e0e03670316: Deleting consensus metadata
I20260806 04:47:26.462791 19644 ts_tablet_manager.cc:1939] T 7d2fbf92417043e38b84ef49773d4c32 P 3d9793be53a94141a93c18613ebacf3f: Deleting consensus metadata
I20260806 04:47:26.464793 19087 catalog_manager.cc:4841] TS 3d9793be53a94141a93c18613ebacf3f (127.7.113.195:45865): tablet 7d2fbf92417043e38b84ef49773d4c32 (table test-table [id=75194ed6bfc04f768b7d7c0698cf148c]) successfully deleted
I20260806 04:47:26.464706 19088 catalog_manager.cc:4841] TS 56230a5cca57441d93581e0e03670316 (127.7.113.194:44743): tablet 7d2fbf92417043e38b84ef49773d4c32 (table test-table [id=75194ed6bfc04f768b7d7c0698cf148c]) successfully deleted
I20260806 04:47:26.467901 19646 ts_tablet_manager.cc:1918] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:47:26.468147 19646 log.cc:1196] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/7d2fbf92417043e38b84ef49773d4c32
I20260806 04:47:26.468894 19646 ts_tablet_manager.cc:1939] T 7d2fbf92417043e38b84ef49773d4c32 P d8752efb8d8e4c4ba554a1d212613de9: Deleting consensus metadata
I20260806 04:47:26.468942 19619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.442381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47916 (local address 127.7.113.193:37395)
0806 04:47:26.442601 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 04:47:26.442610 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:47:26.445972 (+ 3362us) server_negotiation.cc:407] Connection header received
0806 04:47:26.446229 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:47:26.446238 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:47:26.446350 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:47:26.446477 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:47:26.450872 (+ 4395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.452102 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.454662 (+ 2560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.455334 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.455444 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.461098 (+ 5654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:47:26.461112 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:47:26.461129 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:47:26.461176 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:47:26.465417 (+ 4241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:26.466339 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:26.466352 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:26.466356 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:26.466585 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:26.467058 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:26.467063 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:26.467066 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:26.467530 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:47:26.467856 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0806 04:47:26.468201 (+ 345us) server_negotiation.cc:299] Negotiation successful
0806 04:47:26.468509 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 04:47:26.469728 19314 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:47:26.567061 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 19184
W20260806 04:47:26.586700 19088 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.113.193:37395 (error 108)
I20260806 04:47:26.586959 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 19325
I20260806 04:47:26.588629 19618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.588199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:37395 (local address 127.0.0.1:47922)
0806 04:47:26.588397 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:26.588493 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:37395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260806 04:47:26.588999 19088 catalog_manager.cc:4584] TS d8752efb8d8e4c4ba554a1d212613de9 (127.7.113.193:37395): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7d2fbf92417043e38b84ef49773d4c32: Network error: Client connection negotiation failed: client connection to 127.7.113.193:37395: connect: Connection refused (error 111)
Aug 06 04:47:26 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:47:26.602439 19616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.587701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60232 (local address 127.7.113.194:44743)
0806 04:47:26.587900 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 04:47:26.587906 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:47:26.588023 (+ 117us) server_negotiation.cc:407] Connection header received
0806 04:47:26.588644 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:47:26.588649 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:47:26.588720 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:47:26.588836 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:47:26.590294 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.591041 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.592441 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.592851 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.592946 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.596995 (+ 4049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:47:26.597007 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:47:26.597021 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:47:26.597051 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:47:26.599932 (+ 2881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:26.600644 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:26.600650 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:26.600653 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:26.600774 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:26.601102 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:26.601105 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:26.601107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:26.601429 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:47:26.601668 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0806 04:47:26.601919 (+ 251us) server_negotiation.cc:299] Negotiation successful
0806 04:47:26.602074 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 04:47:26.603068 19458 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:47:26.642707 19618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.642156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:37395 (local address 127.0.0.1:47930)
0806 04:47:26.642393 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:26.642517 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:37395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260806 04:47:26.643710 19618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.643346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:37395 (local address 127.0.0.1:47938)
0806 04:47:26.643488 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:26.643580 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:37395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 04:47:26.693310 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 19325
I20260806 04:47:26.704202 19618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.703574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:37395 (local address 127.0.0.1:47950)
0806 04:47:26.703837 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:26.703973 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:37395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260806 04:47:26.705415 19618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.704943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:37395 (local address 127.0.0.1:47958)
0806 04:47:26.705132 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:26.705243 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:37395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260806 04:47:26.713513 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 19469
Aug 06 04:47:26 dist-test-slave-0b58 krb5kdc[18618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:47:26.728341 19617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.714263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51876 (local address 127.7.113.195:45865)
0806 04:47:26.714484 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 04:47:26.714492 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:47:26.714514 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:47:26.714730 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:47:26.714741 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:47:26.714815 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:47:26.714928 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:47:26.716329 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.717051 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.718351 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:47:26.718753 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:47:26.718889 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:47:26.723144 (+ 4255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:47:26.723158 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:47:26.723175 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:47:26.723206 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:47:26.726055 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:26.726668 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:26.726675 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:26.726677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:26.726798 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:47:26.727104 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:47:26.727107 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:47:26.727109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:47:26.727442 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:47:26.727714 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0806 04:47:26.727869 (+ 155us) server_negotiation.cc:299] Negotiation successful
0806 04:47:26.728023 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 04:47:26.729007 19596 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:47:26.786623 19618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.786011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:37395 (local address 127.0.0.1:47972)
0806 04:47:26.786285 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:26.786400 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:37395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260806 04:47:26.787752 19618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:47:26.787292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:37395 (local address 127.0.0.1:47982)
0806 04:47:26.787493 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 04:47:26.787615 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:37395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260806 04:47:26.818029 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 19469
I20260806 04:47:26.836779 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 19071
I20260806 04:47:26.837929 19134 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:47:26.951695 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 19071
I20260806 04:47:26.977908 7623 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 04:47:27.313486 7623 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 04:47:27.313776 7623 mini_ranger.cc:66] Stopping Ranger...
I20260806 04:47:27.659323 7623 mini_ranger.cc:68] Stopped Ranger
2026-08-06 04:47:27.659 UTC [18649] LOG: received smart shutdown request
2026-08-06 04:47:27.663 UTC [18649] LOG: background worker "logical replication launcher" (PID 18658) exited with exit code 1
2026-08-06 04:47:27.663 UTC [18653] LOG: shutting down
2026-08-06 04:47:27.826 UTC [18649] LOG: database system is shut down
2026-08-06T04:47:27Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50176 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:47:28 dist-test-slave-0b58 krb5kdc[19661](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:47:28 dist-test-slave-0b58 krb5kdc[19661](info): set up 2 sockets
Aug 06 04:47:28 dist-test-slave-0b58 krb5kdc[19661](info): commencing operation
krb5kdc: starting...
W20260806 04:47:29.090978 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:47:29 dist-test-slave-0b58 krb5kdc[19661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:47:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:47:29Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.7.113.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.7.113.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/rangeradmin_127.7.113.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/rangeradmin_127.7.113.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.7.113.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.7.113.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/rangerlookup_127.7.113.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/rangerlookup_127.7.113.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.113.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.7.113.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/HTTP_127.7.113.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/HTTP_127.7.113.212@KRBTEST.COM.keytab.
I20260806 04:47:29.455003 7623 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskTmaHtW/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/postgres -l logfile start
2026-08-06 04:47:31.878 UTC [19691] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 04:47:31.878 UTC [19691] LOG: listening on IPv4 address "127.7.113.212", port 37415
2026-08-06 04:47:31.881 UTC [19691] LOG: listening on Unix socket "/tmp/.s.PGSQL.37415"
2026-08-06 04:47:31.905 UTC [19694] LOG: database system was shut down at 2026-08-06 04:47:30 UTC
2026-08-06 04:47:31.909 UTC [19691] LOG: database system is ready to accept connections
I20260806 04:47:32.890214 7623 mini_postgres.cc:96] Postgres bound to 37415
2026-08-06 04:47:32.912 UTC [19702] FATAL: database "slave" does not exist
127.7.113.212:37415 - accepting connections
I20260806 04:47:32.913339 7623 mini_ranger.cc:161] Starting Ranger...
I20260806 04:47:32.942612 7623 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 04:47:33.416742 7623 mini_ranger.cc:87] Created ranger Postgres database
I20260806 04:47:33.416841 7623 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-admin
2026-08-06 04:47:33,701 [I] DB FLAVOR :POSTGRES
2026-08-06 04:47:33,702 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 04:47:33,702 [I] Checking connection..
2026-08-06 04:47:33,702 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 04:47:33,967 [I] Checking connection passed.
2026-08-06 04:47:33,967 [I] --------- Verifying version history table ---------
2026-08-06 04:47:33,967 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 04:47:34,226 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 04:47:34,227 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 04:47:34,481 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 04:47:34,481 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 04:47:34,481 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 04:47:34.734 UTC [19768] WARNING: there is no transaction in progress
2026-08-06 04:47:34,740 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 04:47:34,741 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 04:47:34,999 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 04:47:35,000 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 04:47:35,000 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 04:47:35,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 04:47:35,472 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-0b58.c.gcp-upstream.internal','N') ;"
2026-08-06 04:47:35,685 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 04:47:35,938 [I] Table x_portal_user does not exist in database ranger
2026-08-06 04:47:35,939 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 04:47:36,196 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 04:47:36,196 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 04:47:36,420 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 04:47:36,834 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 04:47:36,834 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 04:47:37.840 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:37.856 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:37.871 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:37.884 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:37.902 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:37.920 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:37.982 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:37.988 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:38.002 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:38.011 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:38.021 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:38.034 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:38.043 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:38.049 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:38.056 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:38.062 UTC [19878] WARNING: there is no transaction in progress
2026-08-06 04:47:38,668 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 04:47:38,668 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 04:47:38,907 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 04:47:38,907 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 04:47:39,155 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 04:47:39,155 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 04:47:39,390 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 04:47:39,390 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 04:47:39,628 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 04:47:39,879 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-0b58.c.gcp-upstream.internal';"
2026-08-06 04:47:40,109 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 04:47:40,109 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 04:47:40,355 [I] DB_PATCHES have already been applied
I20260806 04:47:40.361231 7623 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-admin:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskTmaHtW/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 04:47:40.361337 7623 mini_ranger.cc:193] Using host: 127.7.113.212
I20260806 04:47:40.380957 7623 mini_ranger.cc:227] Ranger admin URL: http://127.7.113.212:38961
Aug 06, 2026 4:47:40 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 4:47:40 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 4:47:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 4:47:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 4:47:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 4:47:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 4:47:41 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 04:47:41.507560 7623 mini_ranger.cc:160] Time spent starting Ranger: real 8.594s user 0.001s sys 0.052s
Aug 06, 2026 4:48:00 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 4:48:00 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 06, 2026 4:48:00 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 4:48:00 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 4:48:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 4:48:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 4:48:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 4:48:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 4:48:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 4:48:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 4:48:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 4:48:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 4:48:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 4:48:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 4:48:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 4:48:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 4:48:00 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 4:48:00 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 04:48:01.516148 7623 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.7.113.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.7.113.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/rangerkms_127.7.113.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.7.113.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/rangerkms_127.7.113.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.113.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.7.113.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.113.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/HTTP_127.7.113.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.113.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/HTTP_127.7.113.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 04:48:01 dist-test-slave-0b58 krb5kdc[19661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991681, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 04:48:01.700143 7623 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 04:48:01.722213 7623 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 04:48:02.549238 7623 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 04:48:02.549345 7623 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-kms
I20260806 04:48:02.549378 7623 mini_ranger_kms.cc:227] Using postgres at 127.7.113.212:37415
2026-08-06 04:48:02,907 [I] DB FLAVOR :POSTGRES
2026-08-06 04:48:02,907 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 04:48:02,907 [I] Checking connection
2026-08-06 04:48:02,907 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 04:48:03,146 [I] connection success
2026-08-06 04:48:03,146 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 04:48:03,147 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 04:48:03,147 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 04:48:03,369 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 04:48:03,370 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 04:48:03,370 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 04:48:03,370 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.113.212:37415/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 04:48:03,615 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 04:48:04.051162 7623 mini_ranger_kms.cc:310] Created kms service
I20260806 04:48:04.219712 7623 mini_ranger_kms.cc:326] Created kudu user
I20260806 04:48:04.267887 7623 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 04:48:04 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991681, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:48:04.685731 7623 mini_ranger_kms.cc:384] Added ranger policy
I20260806 04:48:04.686049 7623 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-kms:/tmp/dist-test-taskTmaHtW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskTmaHtW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 04:48:04.686108 7623 mini_ranger_kms.cc:240] Using host: 127.7.113.212
I20260806 04:48:04.706750 7623 mini_ranger_kms.cc:276] Ranger KMS PID: 20059
I20260806 04:48:04.706858 7623 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.7.113.212:43273
Aug 06, 2026 4:48:05 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 4:48:05 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 4:48:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 4:48:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 4:48:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 4:48:06 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 04:48:06 dist-test-slave-0b58 krb5kdc[19661](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785991686, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.113.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:06.973383 7623 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.273s user 0.083s sys 0.298s
I20260806 04:48:06.973665 7623 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 04:48:06.973843 7623 mini_ranger_kms.cc:401] 127.7.113.212:43273/kms/v1/keys
Aug 06 04:48:07 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991686, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.113.212@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
Aug 06 04:48:07 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991686, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.113.212@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
Aug 06 04:48:09 dist-test-slave-0b58 krb5kdc[19661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:48:10.028618 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:39897
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:39897
--ranger_config_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.113.212:43273/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:10.363265 20111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:10.363523 20111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:10.363618 20111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:10.370777 20111 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:48:10.370890 20111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:10.370934 20111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:10.370981 20111 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:48:10.371019 20111 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:48:10.380398 20111 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/wal
--ranger_kms_url=127.7.113.212:43273/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:39897
--ranger_config_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:39897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:10.381487 20111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:10.382689 20111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:10.394227 20117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:10.394326 20116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:10.394300 20119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:10.394511 20111 server_base.cc:1034] running on GCE node
I20260806 04:48:10.395481 20111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:10.396764 20111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:10.397969 20111 hybrid_clock.cc:648] HybridClock initialized: now 1785991690397927 us; error 28 us; skew 500 ppm
I20260806 04:48:10.398303 20111 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:10 dist-test-slave-0b58 krb5kdc[19661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991690, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:10.401284 20111 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:48:10.402616 20111 webserver.cc:460] Webserver started at http://127.7.113.254:35135/ using document root <none> and password file <none>
I20260806 04:48:10.403210 20111 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:10.403301 20111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:10.403532 20111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 04:48:10 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991690, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:48:10.461335 20111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "e88fa8287da8412fac0f0e11212a6467"
format_stamp: "Formatted at 2026-08-06 04:48:10 on dist-test-slave-0b58"
server_key: "726b4403b318d45f147d3dd788701fab"
server_key_iv: "e833813974cd05e40fdabbcbb3cad5f3"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:10.462182 20111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "e88fa8287da8412fac0f0e11212a6467"
format_stamp: "Formatted at 2026-08-06 04:48:10 on dist-test-slave-0b58"
server_key: "726b4403b318d45f147d3dd788701fab"
server_key_iv: "e833813974cd05e40fdabbcbb3cad5f3"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:10.467391 20111 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 04:48:10.487085 20126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:10.488703 20111 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 04:48:10.488883 20111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "e88fa8287da8412fac0f0e11212a6467"
format_stamp: "Formatted at 2026-08-06 04:48:10 on dist-test-slave-0b58"
server_key: "726b4403b318d45f147d3dd788701fab"
server_key_iv: "e833813974cd05e40fdabbcbb3cad5f3"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:10.489120 20111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:10.501579 20111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:10.505685 20111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:10.506016 20111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:10.525935 20111 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:39897
I20260806 04:48:10.525935 20178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:39897 every 8 connection(s)
I20260806 04:48:10.527280 20111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:48:10.529563 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 20111
I20260806 04:48:10.529781 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:48:10.530478 7623 external_mini_cluster.cc:1428] Setting key 58416e299932fe753e5717fda25a3581
I20260806 04:48:10.531085 20179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:10.545609 20179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467: Bootstrap starting.
Aug 06 04:48:10 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:10.549309 20179 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:10.550386 20179 log.cc:824] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:10.553553 20179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467: No bootstrap required, opened a new log
I20260806 04:48:10.554646 20182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:10.532487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35220 (local address 127.7.113.254:39897)
0806 04:48:10.533330 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:10.533344 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:10.533392 (+ 48us) server_negotiation.cc:407] Connection header received
0806 04:48:10.535878 (+ 2486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:10.535908 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:10.536459 (+ 551us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:10.536917 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:10.538073 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:10.540127 (+ 2054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:10.541516 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:10.542616 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:10.542795 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:10.547127 (+ 4332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:10.547134 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:10.547147 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:10.547191 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:10.550238 (+ 3047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:10.551083 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:10.551093 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:10.551101 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:10.551318 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:10.551827 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:10.551869 (+ 42us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:10.551874 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:10.552563 (+ 689us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:10.552890 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:10.553306 (+ 416us) server_negotiation.cc:299] Negotiation successful
0806 04:48:10.553698 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":376,"threads_started":1}
I20260806 04:48:10.561724 20179 raft_consensus.cc:348] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e88fa8287da8412fac0f0e11212a6467" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } }
I20260806 04:48:10.562109 20179 raft_consensus.cc:374] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:10.562232 20179 raft_consensus.cc:729] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88fa8287da8412fac0f0e11212a6467, State: Initialized, Role: FOLLOWER
I20260806 04:48:10.562819 20179 consensus_queue.cc:260] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e88fa8287da8412fac0f0e11212a6467" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } }
I20260806 04:48:10.563069 20179 raft_consensus.cc:388] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:48:10.563225 20179 raft_consensus.cc:482] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:48:10.563396 20179 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:10.565622 20179 raft_consensus.cc:504] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e88fa8287da8412fac0f0e11212a6467" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } }
I20260806 04:48:10.566082 20179 leader_election.cc:302] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e88fa8287da8412fac0f0e11212a6467; no voters:
I20260806 04:48:10.566691 20179 leader_election.cc:288] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:48:10.566823 20184 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:48:10.567564 20184 raft_consensus.cc:686] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 1 LEADER]: Becoming Leader. State: Replica: e88fa8287da8412fac0f0e11212a6467, State: Running, Role: LEADER
I20260806 04:48:10.568109 20184 consensus_queue.cc:237] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e88fa8287da8412fac0f0e11212a6467" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } }
I20260806 04:48:10.568874 20179 sys_catalog.cc:564] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:48:10.570931 20186 sys_catalog.cc:455] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e88fa8287da8412fac0f0e11212a6467. Latest consensus state: current_term: 1 leader_uuid: "e88fa8287da8412fac0f0e11212a6467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e88fa8287da8412fac0f0e11212a6467" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } } }
I20260806 04:48:10.571233 20186 sys_catalog.cc:458] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:10.571730 20185 sys_catalog.cc:455] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e88fa8287da8412fac0f0e11212a6467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e88fa8287da8412fac0f0e11212a6467" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } } }
I20260806 04:48:10.572043 20185 sys_catalog.cc:458] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:10.572824 20191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:48:10.579021 20191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:48:10.579622 20179 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 04:48:10.602902 20191 catalog_manager.cc:1347] Generated new cluster ID: b605b51fad864a29b01437bd9db4985b
I20260806 04:48:10.603037 20191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:48:10.621269 20191 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:48:10.622681 20191 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:48:10.635535 20191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467: Generated new TSK 0
I20260806 04:48:10.636399 20191 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:48:11.417755 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.113.212:43273/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39897
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 04:48:11 dist-test-slave-0b58 krb5kdc[19661](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785991691, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 04:48:11.825263 20225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:11.825592 20225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:11.825759 20225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:11.834002 20225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:11.834144 20225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:11.834388 20225 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:48:11.849972 20225 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.7.113.212:43273/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:11.851634 20225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:11.853331 20225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:11.871129 20235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:11.871959 20236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:11.880466 20225 server_base.cc:1034] running on GCE node
W20260806 04:48:11.880894 20238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:11.881754 20225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:11.883059 20225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:11.884368 20225 hybrid_clock.cc:648] HybridClock initialized: now 1785991691884305 us; error 45 us; skew 500 ppm
I20260806 04:48:11.884799 20225 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:11 dist-test-slave-0b58 krb5kdc[19661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991691, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:11.888517 20225 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:48:11.890466 20225 webserver.cc:460] Webserver started at http://127.7.113.193:41417/ using document root <none> and password file <none>
I20260806 04:48:11.891498 20225 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:11.891669 20225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:11.892076 20225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 04:48:11 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991691, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:48:11.912949 20225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "5ef94e93bca1493582b976bc8e464994"
format_stamp: "Formatted at 2026-08-06 04:48:11 on dist-test-slave-0b58"
server_key: "2e18ea40814196abe8bfd4883cbd3d74"
server_key_iv: "d15d890f53370c7b61b5d610aec5faea"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:11.914160 20225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "5ef94e93bca1493582b976bc8e464994"
format_stamp: "Formatted at 2026-08-06 04:48:11 on dist-test-slave-0b58"
server_key: "2e18ea40814196abe8bfd4883cbd3d74"
server_key_iv: "d15d890f53370c7b61b5d610aec5faea"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:11.938419 20225 fs_manager.cc:691] Time spent creating directory manager: real 0.024s user 0.007s sys 0.015s
I20260806 04:48:11.958928 20245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:11.960590 20225 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:48:11.960805 20225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "5ef94e93bca1493582b976bc8e464994"
format_stamp: "Formatted at 2026-08-06 04:48:11 on dist-test-slave-0b58"
server_key: "2e18ea40814196abe8bfd4883cbd3d74"
server_key_iv: "d15d890f53370c7b61b5d610aec5faea"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:11.961038 20225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:11.994174 20225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:11.999264 20225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:11.999624 20225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:12.001631 20225 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:12.003326 20225 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:12.003444 20225 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:12.003624 20225 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:12.003757 20225 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260806 04:48:12.062651 20225 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:41591
I20260806 04:48:12.062723 20360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:41591 every 8 connection(s)
I20260806 04:48:12.070204 20225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:48:12.078722 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 20225
I20260806 04:48:12.078936 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:48:12.079761 7623 external_mini_cluster.cc:1428] Setting key 0432c06aab6bbc81c295fea21697175e
Aug 06 04:48:12 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991691, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
I20260806 04:48:12.120059 20364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:12.082220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:59385 (local address 127.7.113.254:39897)
0806 04:48:12.094249 (+ 12029us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:12.094255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:12.096352 (+ 2097us) server_negotiation.cc:407] Connection header received
0806 04:48:12.097795 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:12.097801 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:12.097897 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:12.098009 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:12.099921 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:12.101110 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:12.103631 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:12.104295 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:12.104414 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:12.112289 (+ 7875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:12.112298 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:12.112303 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:12.112362 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:12.116037 (+ 3675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:12.117055 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:12.117061 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:12.117065 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:12.117226 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:12.117808 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:12.117813 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:12.117817 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:12.118186 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:12.118324 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:12.119366 (+ 1042us) server_negotiation.cc:299] Negotiation successful
0806 04:48:12.119650 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11899,"thread_start_us":11784,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
I20260806 04:48:12.125898 20363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:12.081616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:39897 (local address 127.7.113.193:59385)
0806 04:48:12.094860 (+ 13244us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:12.094914 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:12.097379 (+ 2465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:12.098280 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:12.098293 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:12.098945 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:12.099698 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:12.099722 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:12.101306 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:12.101312 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:12.103434 (+ 2122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:12.103452 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:12.104777 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:12.104786 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:12.105071 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:12.105912 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:12.105942 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:12.111946 (+ 6004us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:12.116280 (+ 4334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:12.116290 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:12.116309 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:12.116906 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:12.117400 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:12.117405 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:12.117409 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:12.117656 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:12.118411 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:12.118420 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:12.118891 (+ 471us) client_negotiation.cc:769] Sending connection context
0806 04:48:12.119217 (+ 326us) client_negotiation.cc:240] Negotiation successful
0806 04:48:12.119786 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12926,"thread_start_us":12691,"threads_started":1}
I20260806 04:48:12.134462 20361 heartbeater.cc:347] Connected to a master server at 127.7.113.254:39897
I20260806 04:48:12.134828 20361 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:12.135738 20361 heartbeater.cc:511] Master 127.7.113.254:39897 requested a full tablet report, sending...
I20260806 04:48:12.138423 20143 ts_manager.cc:194] Registered new tserver with Master: 5ef94e93bca1493582b976bc8e464994 (127.7.113.193:41591)
I20260806 04:48:12.140614 20143 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:59385
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:48:12.159801 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.113.212:43273/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39897
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 04:48:12 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991691, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
W20260806 04:48:12.593042 20367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:12.593466 20367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:12.593662 20367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:12.605243 20367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:12.605377 20367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:12.605611 20367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
Aug 06 04:48:12 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991691, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:48:12.621551 20367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.7.113.212:43273/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:12.625541 20367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:12.627776 20367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:12.666631 20373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:12.666919 20375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:12.678128 20377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:12.678130 20367 server_base.cc:1034] running on GCE node
I20260806 04:48:12.679061 20367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:12.692729 20367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:12.708501 20367 hybrid_clock.cc:648] HybridClock initialized: now 1785991692708407 us; error 97 us; skew 500 ppm
I20260806 04:48:12.709079 20367 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:12 dist-test-slave-0b58 krb5kdc[19661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991692, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:12.713667 20367 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:48:12.743005 20367 webserver.cc:460] Webserver started at http://127.7.113.194:35391/ using document root <none> and password file <none>
I20260806 04:48:12.744110 20367 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:12.744362 20367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:12.744784 20367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 04:48:12 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991692, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:48:12.764820 20367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "7826bcf0eb0a4523afa27cff7ccd23c6"
format_stamp: "Formatted at 2026-08-06 04:48:12 on dist-test-slave-0b58"
server_key: "e7b252f9044a51552534954221fadf28"
server_key_iv: "4ba7adcc4555ec574312834cd500feb1"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:12.766018 20367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "7826bcf0eb0a4523afa27cff7ccd23c6"
format_stamp: "Formatted at 2026-08-06 04:48:12 on dist-test-slave-0b58"
server_key: "e7b252f9044a51552534954221fadf28"
server_key_iv: "4ba7adcc4555ec574312834cd500feb1"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:12.786022 20367 fs_manager.cc:691] Time spent creating directory manager: real 0.019s user 0.007s sys 0.011s
I20260806 04:48:12.810505 20384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:12.812566 20367 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.009s sys 0.001s
I20260806 04:48:12.812856 20367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "7826bcf0eb0a4523afa27cff7ccd23c6"
format_stamp: "Formatted at 2026-08-06 04:48:12 on dist-test-slave-0b58"
server_key: "e7b252f9044a51552534954221fadf28"
server_key_iv: "4ba7adcc4555ec574312834cd500feb1"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:12.813184 20367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:12.860078 20367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:12.865453 20367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:12.865909 20367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:12.873323 20367 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:12.881564 20367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:12.881733 20367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260806 04:48:12.881914 20367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:12.882014 20367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:13.007332 20367 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:38169
I20260806 04:48:13.007373 20506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:38169 every 8 connection(s)
I20260806 04:48:13.009172 20367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:48:13.009933 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 20367
I20260806 04:48:13.010155 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:48:13.010895 7623 external_mini_cluster.cc:1428] Setting key cd9878d32e607b7f0f1ebf680bd0f502
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
Aug 06 04:48:13 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991692, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:13.059866 20510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:13.013492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:51385 (local address 127.7.113.254:39897)
0806 04:48:13.039595 (+ 26103us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:13.039602 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:13.039622 (+ 20us) server_negotiation.cc:407] Connection header received
0806 04:48:13.039733 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:13.039739 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:13.039817 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:13.039933 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:13.043087 (+ 3154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:13.044304 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:13.046715 (+ 2411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:13.047374 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:13.047481 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:13.052849 (+ 5368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:13.052855 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:13.052860 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:13.052908 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:13.056133 (+ 3225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:13.057009 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:13.057015 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:13.057018 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:13.057213 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:13.057744 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:13.057748 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:13.057751 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:13.058089 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:13.058225 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:13.059250 (+ 1025us) server_negotiation.cc:299] Negotiation successful
0806 04:48:13.059486 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25962,"thread_start_us":27385,"threads_started":1}
I20260806 04:48:13.062538 20509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:13.012713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:39897 (local address 127.7.113.194:51385)
0806 04:48:13.036120 (+ 23407us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:13.036200 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:13.038745 (+ 2545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:13.041285 (+ 2540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:13.041297 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:13.041944 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:13.042858 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:13.042883 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:13.044508 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:13.044513 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:13.046545 (+ 2032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:13.046560 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:13.047840 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:13.047846 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:13.048107 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:13.049172 (+ 1065us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:13.049205 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:13.052569 (+ 3364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:13.056314 (+ 3745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:13.056322 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:13.056338 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:13.056876 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:13.057359 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:13.057363 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:13.057366 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:13.057601 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:13.058321 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:13.058328 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:13.058791 (+ 463us) client_negotiation.cc:769] Sending connection context
0806 04:48:13.060495 (+ 1704us) client_negotiation.cc:240] Negotiation successful
0806 04:48:13.061050 (+ 555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23056,"thread_start_us":27238,"threads_started":1}
I20260806 04:48:13.064540 20507 heartbeater.cc:347] Connected to a master server at 127.7.113.254:39897
I20260806 04:48:13.064841 20507 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:13.065701 20507 heartbeater.cc:511] Master 127.7.113.254:39897 requested a full tablet report, sending...
I20260806 04:48:13.067538 20143 ts_manager.cc:194] Registered new tserver with Master: 7826bcf0eb0a4523afa27cff7ccd23c6 (127.7.113.194:38169)
I20260806 04:48:13.068722 20143 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:51385
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:48:13.100244 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.113.212:43273/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39897
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:48:13.144495 20361 heartbeater.cc:503] Master 127.7.113.254:39897 was elected leader, sending a full tablet report...
W20260806 04:48:13.467885 20513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:13.468125 20513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:13.468353 20513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:13.475863 20513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:13.475981 20513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:13.476159 20513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:48:13.485960 20513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.7.113.212:43273/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:13.487401 20513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:13.488933 20513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:13.501902 20521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:13.502053 20518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:13.501976 20519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:13.503082 20513 server_base.cc:1034] running on GCE node
I20260806 04:48:13.503695 20513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:13.504673 20513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:13.505874 20513 hybrid_clock.cc:648] HybridClock initialized: now 1785991693505838 us; error 32 us; skew 500 ppm
I20260806 04:48:13.506150 20513 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:13 dist-test-slave-0b58 krb5kdc[19661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991693, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:13.514490 20513 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:48:13.515863 20513 webserver.cc:460] Webserver started at http://127.7.113.195:44327/ using document root <none> and password file <none>
I20260806 04:48:13.516618 20513 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:13.516762 20513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:13.517103 20513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 04:48:13 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991693, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:48:13.535547 20513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "20e2b8c622c0484a9b6789a788d2928f"
format_stamp: "Formatted at 2026-08-06 04:48:13 on dist-test-slave-0b58"
server_key: "a890806f53c13e47dd13c4b5a036a04e"
server_key_iv: "1b18ad85f911ec51d6d26916ba336e34"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:13.536712 20513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "20e2b8c622c0484a9b6789a788d2928f"
format_stamp: "Formatted at 2026-08-06 04:48:13 on dist-test-slave-0b58"
server_key: "a890806f53c13e47dd13c4b5a036a04e"
server_key_iv: "1b18ad85f911ec51d6d26916ba336e34"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:13.542734 20513 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 04:48:13.559819 20528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:13.561625 20513 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 04:48:13.561792 20513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "20e2b8c622c0484a9b6789a788d2928f"
format_stamp: "Formatted at 2026-08-06 04:48:13 on dist-test-slave-0b58"
server_key: "a890806f53c13e47dd13c4b5a036a04e"
server_key_iv: "1b18ad85f911ec51d6d26916ba336e34"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:13.562047 20513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:13.586959 20513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:13.590941 20513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:13.591238 20513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:13.592178 20513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:13.593652 20513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:13.593747 20513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:13.593900 20513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:13.593982 20513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:13.626001 20513 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:35433
I20260806 04:48:13.626035 20641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:35433 every 8 connection(s)
I20260806 04:48:13.627276 20513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:48:13.634723 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 20513
I20260806 04:48:13.634922 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:48:13.635443 7623 external_mini_cluster.cc:1428] Setting key 82baaa4579eb146df739ee9f8a1c8a64
Aug 06 04:48:13 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991693, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:13.646477 20644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:13.629744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:46631 (local address 127.7.113.254:39897)
0806 04:48:13.630236 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:13.630242 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:13.631156 (+ 914us) server_negotiation.cc:407] Connection header received
0806 04:48:13.632968 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:13.632972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:13.633057 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:13.633154 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:13.634473 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:13.635292 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:13.637469 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:13.638135 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:13.638258 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:13.641540 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:13.641544 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:13.641547 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:13.641578 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:13.643943 (+ 2365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:13.644637 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:13.644641 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:13.644643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:13.644761 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:13.645147 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:13.645150 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:13.645152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:13.645405 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:13.645510 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:13.646065 (+ 555us) server_negotiation.cc:299] Negotiation successful
0806 04:48:13.646231 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":229,"threads_started":1}
I20260806 04:48:13.647372 20645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:13.630317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:39897 (local address 127.7.113.195:46631)
0806 04:48:13.630990 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:13.631035 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:13.632726 (+ 1691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:13.633355 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:13.633363 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:13.633754 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:13.634292 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:13.634309 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:13.635444 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:13.635450 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:13.637313 (+ 1863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:13.637327 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:13.638375 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:13.638384 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:13.638667 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:13.639319 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:13.639339 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:13.641360 (+ 2021us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:13.644061 (+ 2701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:13.644068 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:13.644078 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:13.644535 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:13.644870 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:13.644873 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:13.644875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:13.645050 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:13.645510 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:13.645515 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:13.645761 (+ 246us) client_negotiation.cc:769] Sending connection context
0806 04:48:13.645978 (+ 217us) client_negotiation.cc:240] Negotiation successful
0806 04:48:13.646321 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":283,"threads_started":1}
I20260806 04:48:13.648660 20642 heartbeater.cc:347] Connected to a master server at 127.7.113.254:39897
I20260806 04:48:13.648954 20642 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:13.649811 20642 heartbeater.cc:511] Master 127.7.113.254:39897 requested a full tablet report, sending...
I20260806 04:48:13.651250 20143 ts_manager.cc:194] Registered new tserver with Master: 20e2b8c622c0484a9b6789a788d2928f (127.7.113.195:35433)
I20260806 04:48:13.652007 20143 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:46631
I20260806 04:48:13.663165 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:48:13.664979 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 20225
Aug 06 04:48:13 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:48:13.681396 20647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:13.665818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38048 (local address 127.7.113.193:41591)
0806 04:48:13.666519 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:13.666534 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:13.666578 (+ 44us) server_negotiation.cc:407] Connection header received
0806 04:48:13.666673 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:13.666682 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:13.666898 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:13.667052 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:13.668677 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:13.669708 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:13.671179 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:13.671701 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:13.671841 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:13.676094 (+ 4253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:13.676104 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:13.676116 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:13.676146 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:13.678683 (+ 2537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:13.679340 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:13.679348 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:13.679351 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:13.679483 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:13.679860 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:13.679867 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:13.679874 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:13.680171 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:13.680526 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:13.680783 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 04:48:13.681063 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":356,"threads_started":1}
I20260806 04:48:13.682837 20356 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:13.766129 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 20225
I20260806 04:48:13.784031 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 20367
Aug 06 04:48:13 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:48:13.800431 20649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:13.784954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34784 (local address 127.7.113.194:38169)
0806 04:48:13.785483 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:13.785490 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:13.785516 (+ 26us) server_negotiation.cc:407] Connection header received
0806 04:48:13.785575 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:13.785581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:13.785783 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:13.785919 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:13.787550 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:13.788658 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:13.789992 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:13.790496 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:13.790586 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:13.794870 (+ 4284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:13.794880 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:13.794893 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:13.794921 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:13.797633 (+ 2712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:13.798284 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:13.798292 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:13.798294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:13.798422 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:13.798807 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:13.798813 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:13.798816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:13.799146 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:13.799454 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:13.799760 (+ 306us) server_negotiation.cc:299] Negotiation successful
0806 04:48:13.800034 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":277,"threads_started":1}
I20260806 04:48:13.801596 20502 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:13.883078 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 20367
I20260806 04:48:13.900835 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 20513
Aug 06 04:48:13 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:48:13.917531 20651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:13.902079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52928 (local address 127.7.113.195:35433)
0806 04:48:13.902695 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:13.902702 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:13.902731 (+ 29us) server_negotiation.cc:407] Connection header received
0806 04:48:13.902791 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:13.902797 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:13.903016 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:13.903185 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:13.904632 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:13.905630 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:13.906917 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:13.907499 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:13.907643 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:13.912037 (+ 4394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:13.912048 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:13.912061 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:13.912090 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:13.914705 (+ 2615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:13.915385 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:13.915393 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:13.915395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:13.915519 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:13.915912 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:13.915919 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:13.915927 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:13.916238 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:13.916653 (+ 415us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:13.916931 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 04:48:13.917191 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":320,"threads_started":1}
I20260806 04:48:13.918766 20637 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:13.999569 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 20513
I20260806 04:48:14.018033 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 20111
I20260806 04:48:14.019236 20174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:14.131615 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 20111
I20260806 04:48:14.155031 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:39897
--webserver_interface=127.7.113.254
--webserver_port=35135
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:39897
--ranger_config_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.113.212:43273/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.113.212:43273/kms with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:14.482470 20654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:14.482730 20654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:14.482856 20654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:14.490026 20654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:48:14.490116 20654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:14.490160 20654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:14.490238 20654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:48:14.490329 20654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:48:14.500145 20654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.113.212:43273/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:39897
--ranger_config_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:39897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=35135
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:14.501350 20654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:14.502614 20654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:14.514322 20659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:14.514562 20662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:14.514780 20660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:14.515341 20654 server_base.cc:1034] running on GCE node
I20260806 04:48:14.515982 20654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:14.517249 20654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:14.518469 20654 hybrid_clock.cc:648] HybridClock initialized: now 1785991694518412 us; error 24 us; skew 500 ppm
I20260806 04:48:14.518769 20654 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:14 dist-test-slave-0b58 krb5kdc[19661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991694, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:14.521759 20654 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:48:14.523070 20654 webserver.cc:460] Webserver started at http://127.7.113.254:35135/ using document root <none> and password file <none>
I20260806 04:48:14.523645 20654 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:14.523741 20654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 04:48:14 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991694, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:48:14.605816 20654 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260806 04:48:14.608829 20670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:14.610124 20654 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:48:14.610327 20654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "e88fa8287da8412fac0f0e11212a6467"
format_stamp: "Formatted at 2026-08-06 04:48:10 on dist-test-slave-0b58"
server_key: "726b4403b318d45f147d3dd788701fab"
server_key_iv: "e833813974cd05e40fdabbcbb3cad5f3"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:14.611302 20654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:14.633030 20654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:14.636504 20654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:14.636806 20654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:14.655092 20654 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:39897
I20260806 04:48:14.655102 20721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:39897 every 8 connection(s)
I20260806 04:48:14.656533 20654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:48:14.662918 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 20654
I20260806 04:48:14.663358 20722 sys_catalog.cc:263] Verifying existing consensus state
I20260806 04:48:14.664057 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.113.212:43273/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:41591
--local_ip_for_outbound_sockets=127.7.113.193
--tserver_master_addrs=127.7.113.254:39897
--webserver_port=41417
--webserver_interface=127.7.113.193
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.113.212:43273/kms with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:48:14.668387 20722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467: Bootstrap starting.
I20260806 04:48:14.688529 20722 log.cc:824] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:14.697162 20722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 04:48:14.697710 20722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467: Bootstrap complete.
I20260806 04:48:14.706624 20722 raft_consensus.cc:348] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e88fa8287da8412fac0f0e11212a6467" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } }
I20260806 04:48:14.707479 20722 raft_consensus.cc:729] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88fa8287da8412fac0f0e11212a6467, State: Initialized, Role: FOLLOWER
I20260806 04:48:14.708295 20722 consensus_queue.cc:260] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e88fa8287da8412fac0f0e11212a6467" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } }
I20260806 04:48:14.708568 20722 raft_consensus.cc:388] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:48:14.708712 20722 raft_consensus.cc:482] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:48:14.708909 20722 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 1 FOLLOWER]: Advancing to term 2
I20260806 04:48:14.712618 20722 raft_consensus.cc:504] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e88fa8287da8412fac0f0e11212a6467" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } }
I20260806 04:48:14.713089 20722 leader_election.cc:302] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e88fa8287da8412fac0f0e11212a6467; no voters:
I20260806 04:48:14.713743 20722 leader_election.cc:288] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 04:48:14.713888 20727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 04:48:14.715109 20727 raft_consensus.cc:686] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [term 2 LEADER]: Becoming Leader. State: Replica: e88fa8287da8412fac0f0e11212a6467, State: Running, Role: LEADER
I20260806 04:48:14.715701 20727 consensus_queue.cc:237] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e88fa8287da8412fac0f0e11212a6467" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } }
I20260806 04:48:14.716099 20722 sys_catalog.cc:564] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:48:14.718262 20729 sys_catalog.cc:455] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e88fa8287da8412fac0f0e11212a6467. Latest consensus state: current_term: 2 leader_uuid: "e88fa8287da8412fac0f0e11212a6467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e88fa8287da8412fac0f0e11212a6467" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } } }
I20260806 04:48:14.718716 20729 sys_catalog.cc:458] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:14.719352 20728 sys_catalog.cc:455] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e88fa8287da8412fac0f0e11212a6467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e88fa8287da8412fac0f0e11212a6467" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39897 } } }
I20260806 04:48:14.719683 20728 sys_catalog.cc:458] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:14.728407 20733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:48:14.734141 20733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:48:14.735479 20733 catalog_manager.cc:1259] Loaded cluster ID: b605b51fad864a29b01437bd9db4985b
I20260806 04:48:14.735617 20733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:48:14.741170 20733 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:48:14.743194 20733 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467: Loaded TSK: 0
I20260806 04:48:14.745062 20733 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:48:14.747907 20722 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260806 04:48:15.120994 20725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:15.121506 20725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:15.121729 20725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:15.133147 20725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:15.133396 20725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:15.133635 20725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:48:15.147921 20725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.113.212:43273/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:41591
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=41417
--tserver_master_addrs=127.7.113.254:39897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:15.149479 20725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:15.150961 20725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:15.169160 20761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:15.169566 20762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:15.174024 20725 server_base.cc:1034] running on GCE node
W20260806 04:48:15.174443 20765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:15.175388 20725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:15.176784 20725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:15.178110 20725 hybrid_clock.cc:648] HybridClock initialized: now 1785991695178034 us; error 59 us; skew 500 ppm
I20260806 04:48:15.178565 20725 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:15 dist-test-slave-0b58 krb5kdc[19661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991695, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:15.183069 20725 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:48:15.185712 20725 webserver.cc:460] Webserver started at http://127.7.113.193:41417/ using document root <none> and password file <none>
I20260806 04:48:15.186463 20725 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:15.186633 20725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 04:48:15 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991695, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:48:15.233395 20725 fs_manager.cc:709] Time spent opening directory manager: real 0.015s user 0.005s sys 0.001s
I20260806 04:48:15.241024 20773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:15.245823 20725 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.004s sys 0.000s
I20260806 04:48:15.246021 20725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "5ef94e93bca1493582b976bc8e464994"
format_stamp: "Formatted at 2026-08-06 04:48:11 on dist-test-slave-0b58"
server_key: "2e18ea40814196abe8bfd4883cbd3d74"
server_key_iv: "d15d890f53370c7b61b5d610aec5faea"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:15.247570 20725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:15.276600 20725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:15.281733 20725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:15.282099 20725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:15.283350 20725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:15.285220 20725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:15.285333 20725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:15.285446 20725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:15.285526 20725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:15.351994 20886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:41591 every 8 connection(s)
I20260806 04:48:15.352398 20725 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:41591
I20260806 04:48:15.354377 20725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:48:15.355007 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 20725
I20260806 04:48:15.355865 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.113.212:43273/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:38169
--local_ip_for_outbound_sockets=127.7.113.194
--tserver_master_addrs=127.7.113.254:39897
--webserver_port=35391
--webserver_interface=127.7.113.194
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.113.212:43273/kms with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 04:48:15 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991695, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:15.400173 20889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:15.363365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:39897 (local address 127.7.113.193:46163)
0806 04:48:15.368863 (+ 5498us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:15.368915 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:15.371283 (+ 2368us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:15.376117 (+ 4834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:15.376128 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:15.376807 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:15.377529 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:15.377553 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:15.379942 (+ 2389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:15.379948 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:15.382047 (+ 2099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:15.382062 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:15.383793 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:15.383800 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:15.384068 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:15.384828 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:15.384857 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:15.390568 (+ 5711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:15.395111 (+ 4543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:15.395120 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:15.395135 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:15.395560 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:15.396030 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:15.396035 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:15.396038 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:15.396323 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:15.397366 (+ 1043us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:15.397374 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:15.397802 (+ 428us) client_negotiation.cc:769] Sending connection context
0806 04:48:15.398128 (+ 326us) client_negotiation.cc:240] Negotiation successful
0806 04:48:15.398735 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5197,"thread_start_us":4964,"threads_started":1}
I20260806 04:48:15.401612 20890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:15.364479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:46163 (local address 127.7.113.254:39897)
0806 04:48:15.374637 (+ 10158us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:15.374654 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:15.374695 (+ 41us) server_negotiation.cc:407] Connection header received
0806 04:48:15.375099 (+ 404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:15.375114 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:15.375546 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:15.375948 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:15.377792 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:15.379732 (+ 1940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:15.382233 (+ 2501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:15.383239 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:15.383419 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:15.390894 (+ 7475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:15.390905 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:15.390923 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:15.390975 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:15.394960 (+ 3985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:15.395735 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:15.395742 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:15.395747 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:15.395909 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:15.396458 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:15.396466 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:15.396472 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:15.397198 (+ 726us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:15.397407 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:15.399730 (+ 2323us) server_negotiation.cc:299] Negotiation successful
0806 04:48:15.400188 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9900,"thread_start_us":9715,"threads_started":1}
I20260806 04:48:15.404719 20887 heartbeater.cc:347] Connected to a master server at 127.7.113.254:39897
I20260806 04:48:15.405035 20887 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:15.405730 20887 heartbeater.cc:511] Master 127.7.113.254:39897 requested a full tablet report, sending...
W20260806 04:48:15.408810 20887 heartbeater.cc:644] Failed to heartbeat to 127.7.113.254:39897 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 04:48:15.409047 20887 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:15.409323 20887 heartbeater.cc:511] Master 127.7.113.254:39897 requested a full tablet report, sending...
I20260806 04:48:15.410473 20887 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:15.410703 20887 heartbeater.cc:511] Master 127.7.113.254:39897 requested a full tablet report, sending...
W20260806 04:48:15.411751 20887 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 04:48:15.768039 20891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:15.768349 20891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:15.768537 20891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:15.776091 20891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:15.776273 20891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:15.776549 20891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:48:15.786463 20891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.113.212:43273/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:38169
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=35391
--tserver_master_addrs=127.7.113.254:39897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:15.787705 20891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:15.789124 20891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:15.806021 20904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:15.807168 20903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:15.807197 20907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:15.807446 20891 server_base.cc:1034] running on GCE node
I20260806 04:48:15.808228 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:15.812510 20891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:15.813736 20891 hybrid_clock.cc:648] HybridClock initialized: now 1785991695813674 us; error 53 us; skew 500 ppm
I20260806 04:48:15.814044 20891 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:15 dist-test-slave-0b58 krb5kdc[19661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991695, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:15.817538 20891 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:48:15.825050 20891 webserver.cc:460] Webserver started at http://127.7.113.194:35391/ using document root <none> and password file <none>
I20260806 04:48:15.825798 20891 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:15.825960 20891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 04:48:15 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991695, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:48:15.860107 20891 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.000s sys 0.004s
I20260806 04:48:15.863719 20916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:15.865353 20891 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:48:15.865579 20891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "7826bcf0eb0a4523afa27cff7ccd23c6"
format_stamp: "Formatted at 2026-08-06 04:48:12 on dist-test-slave-0b58"
server_key: "e7b252f9044a51552534954221fadf28"
server_key_iv: "4ba7adcc4555ec574312834cd500feb1"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:15.866950 20891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:15.902349 20891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:15.907850 20891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:15.908217 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:15.924670 20891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:15.930732 20891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:15.930939 20891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:15.931092 20891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:15.931210 20891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:15.976651 20891 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:38169
I20260806 04:48:15.976730 21032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:38169 every 8 connection(s)
I20260806 04:48:15.978530 20891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:48:15.984100 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 20891
I20260806 04:48:15.984884 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.113.212:43273/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:35433
--local_ip_for_outbound_sockets=127.7.113.195
--tserver_master_addrs=127.7.113.254:39897
--webserver_port=44327
--webserver_interface=127.7.113.195
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.113.212:43273/kms with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 04:48:15 dist-test-slave-0b58 krb5kdc[19661](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785991695, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 04:48:16 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991695, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:16.017154 21036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:15.982620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:44349 (local address 127.7.113.254:39897)
0806 04:48:15.993319 (+ 10699us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:15.993325 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:15.993349 (+ 24us) server_negotiation.cc:407] Connection header received
0806 04:48:15.993802 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:15.993808 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:15.993895 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:15.993996 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:15.996056 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:15.997262 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:15.999698 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.000369 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.000468 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:16.009333 (+ 8865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:16.009340 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:16.009345 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:16.009388 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:16.013064 (+ 3676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:16.014054 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:16.014063 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:16.014068 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:16.014227 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:16.014904 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:16.014909 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:16.014913 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:16.015272 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:16.015460 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:16.016534 (+ 1074us) server_negotiation.cc:299] Negotiation successful
0806 04:48:16.016774 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10562,"thread_start_us":13644,"threads_started":1}
I20260806 04:48:16.019697 21035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:15.982035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:39897 (local address 127.7.113.194:44349)
0806 04:48:15.990003 (+ 7968us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:15.990053 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:15.992407 (+ 2354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:15.994432 (+ 2025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:15.994443 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:15.995019 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:15.995823 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:15.995853 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:15.997486 (+ 1633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:15.997491 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:15.999511 (+ 2020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:15.999535 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.000803 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.000811 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:16.001114 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:16.003767 (+ 2653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:16.003806 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:16.009037 (+ 5231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:16.013233 (+ 4196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:16.013244 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:16.013264 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:16.013881 (+ 617us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:16.014474 (+ 593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:16.014480 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:16.014483 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:16.014762 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:16.015568 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:16.015576 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:16.016060 (+ 484us) client_negotiation.cc:769] Sending connection context
0806 04:48:16.017700 (+ 1640us) client_negotiation.cc:240] Negotiation successful
0806 04:48:16.018253 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7673,"thread_start_us":7445,"threads_started":1}
I20260806 04:48:16.021610 21033 heartbeater.cc:347] Connected to a master server at 127.7.113.254:39897
I20260806 04:48:16.021915 21033 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:16.022732 21033 heartbeater.cc:511] Master 127.7.113.254:39897 requested a full tablet report, sending...
I20260806 04:48:16.024890 20687 ts_manager.cc:194] Registered new tserver with Master: 7826bcf0eb0a4523afa27cff7ccd23c6 (127.7.113.194:38169)
I20260806 04:48:16.027066 20687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:44349
Aug 06 04:48:16 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991695, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:48:16.411897 20887 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:16.412343 20887 heartbeater.cc:511] Master 127.7.113.254:39897 requested a full tablet report, sending...
I20260806 04:48:16.413635 20687 ts_manager.cc:194] Registered new tserver with Master: 5ef94e93bca1493582b976bc8e464994 (127.7.113.193:41591)
I20260806 04:48:16.414799 20687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:46163
W20260806 04:48:16.418874 21037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:16.419159 21037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:16.419344 21037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:16.429804 21037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:16.429965 21037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:16.430204 21037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:48:16.443305 21037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.113.212:43273/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:35433
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=44327
--tserver_master_addrs=127.7.113.254:39897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:16.445103 21037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:16.446813 21037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:16.467981 21045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:16.467978 21044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:16.476226 21037 server_base.cc:1034] running on GCE node
W20260806 04:48:16.476981 21048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:16.477836 21037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:16.479144 21037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:16.480437 21037 hybrid_clock.cc:648] HybridClock initialized: now 1785991696480374 us; error 49 us; skew 500 ppm
I20260806 04:48:16.480824 21037 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:16 dist-test-slave-0b58 krb5kdc[19661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991696, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:16.484998 21037 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:48:16.493745 21037 webserver.cc:460] Webserver started at http://127.7.113.195:44327/ using document root <none> and password file <none>
I20260806 04:48:16.494676 21037 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:16.494841 21037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 04:48:16 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991696, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:48:16.521886 21037 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.000s sys 0.008s
I20260806 04:48:16.524848 21055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:16.526525 21037 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:48:16.526726 21037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "20e2b8c622c0484a9b6789a788d2928f"
format_stamp: "Formatted at 2026-08-06 04:48:13 on dist-test-slave-0b58"
server_key: "a890806f53c13e47dd13c4b5a036a04e"
server_key_iv: "1b18ad85f911ec51d6d26916ba336e34"
server_key_version: "kuduclusterkey@0"
I20260806 04:48:16.527845 21037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:16.551760 21037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:16.556793 21037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:16.557098 21037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:16.558416 21037 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:16.560168 21037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:16.560316 21037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:16.560444 21037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:16.560537 21037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:16.607384 21037 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:35433
I20260806 04:48:16.607448 21170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:35433 every 8 connection(s)
I20260806 04:48:16.609352 21037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:48:16.619297 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 21037
Aug 06 04:48:16 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991696, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:16.670094 21176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:16.635932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37588 (local address 127.7.113.254:39897)
0806 04:48:16.647005 (+ 11073us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:16.647010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:16.647028 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:48:16.647072 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:16.647077 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:16.647160 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:16.647279 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:16.649628 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.650738 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.652867 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.653571 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.657335 (+ 3764us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:16.657615 (+ 280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:16.657620 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:16.657624 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:16.657651 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:16.666046 (+ 8395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:16.666954 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:16.666959 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:16.666963 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:16.667106 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:16.667598 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:16.667603 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:16.667606 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:16.668000 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:16.669253 (+ 1253us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:16.669392 (+ 139us) server_negotiation.cc:299] Negotiation successful
0806 04:48:16.669617 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10941,"thread_start_us":10772,"threads_started":1}
I20260806 04:48:16.673584 21173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:16.612332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:43341 (local address 127.7.113.254:39897)
0806 04:48:16.635967 (+ 23635us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:16.635973 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:16.637894 (+ 1921us) server_negotiation.cc:407] Connection header received
0806 04:48:16.640666 (+ 2772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:16.640671 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:16.640782 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:16.640892 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:16.643052 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.644179 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.647486 (+ 3307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.648181 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.648303 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:16.652965 (+ 4662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:16.652972 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:16.652976 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:16.653017 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:16.667544 (+ 14527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:16.668581 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:16.668587 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:16.668591 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:16.668718 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:16.669503 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:16.669508 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:16.669511 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:16.669860 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:16.669987 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:16.671806 (+ 1819us) server_negotiation.cc:299] Negotiation successful
0806 04:48:16.673204 (+ 1398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23506,"thread_start_us":23376,"threads_started":1}
I20260806 04:48:16.674338 21174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:16.613046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:39897 (local address 127.7.113.195:43341)
0806 04:48:16.636569 (+ 23523us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:16.636623 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:16.640182 (+ 3559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:16.641369 (+ 1187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:16.641381 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:16.641995 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:16.642839 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:16.642863 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.644404 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.644410 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:16.646463 (+ 2053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:16.646478 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.648661 (+ 2183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.648668 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:16.648972 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:16.649741 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:16.649773 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:16.652709 (+ 2936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:16.667733 (+ 15024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:16.667742 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:16.667759 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:16.668447 (+ 688us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:16.668867 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:16.668872 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:16.668876 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:16.669352 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:16.670105 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:16.670113 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:16.671001 (+ 888us) client_negotiation.cc:769] Sending connection context
0806 04:48:16.672350 (+ 1349us) client_negotiation.cc:240] Negotiation successful
0806 04:48:16.672894 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23188,"thread_start_us":24744,"threads_started":1}
I20260806 04:48:16.675820 21171 heartbeater.cc:347] Connected to a master server at 127.7.113.254:39897
I20260806 04:48:16.676121 21171 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:16.676988 21171 heartbeater.cc:511] Master 127.7.113.254:39897 requested a full tablet report, sending...
I20260806 04:48:16.678587 20687 ts_manager.cc:194] Registered new tserver with Master: 20e2b8c622c0484a9b6789a788d2928f (127.7.113.195:35433)
I20260806 04:48:16.679680 20687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:43341
I20260806 04:48:16.685499 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:48:16.706701 21173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:16.689268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37604 (local address 127.7.113.254:39897)
0806 04:48:16.689594 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:16.689599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:16.689953 (+ 354us) server_negotiation.cc:407] Connection header received
0806 04:48:16.690217 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:16.690223 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:16.690299 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:16.690400 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:16.692555 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.693657 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.695706 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.696398 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.696497 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:16.700066 (+ 3569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:16.700073 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:16.700078 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:16.700115 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:16.703447 (+ 3332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:16.704308 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:16.704313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:16.704317 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:16.704460 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:16.704939 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:16.704944 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:16.704948 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:16.705314 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:16.705537 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:16.706104 (+ 567us) server_negotiation.cc:299] Negotiation successful
0806 04:48:16.706360 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202}
I20260806 04:48:16.713356 20687 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37604:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:48:16.726078 20687 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 06 04:48:16 dist-test-slave-0b58 krb5kdc[19661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991695, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for HTTP/127.7.113.212@KRBTEST.COM
I20260806 04:48:16.804400 21187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:16.766058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:38169 (local address 127.0.0.1:34788)
0806 04:48:16.777594 (+ 11536us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:16.777640 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:16.777852 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:16.797380 (+ 19528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:16.797388 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:16.797424 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:16.797908 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:16.797936 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.800160 (+ 2224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.800167 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:16.801991 (+ 1824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:16.802009 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.803405 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.803411 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:16.803602 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:16.803656 (+ 54us) client_negotiation.cc:769] Sending connection context
0806 04:48:16.803795 (+ 139us) client_negotiation.cc:240] Negotiation successful
0806 04:48:16.803995 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11226,"thread_start_us":11086,"threads_started":1}
I20260806 04:48:16.805644 21188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:16.766108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34788 (local address 127.7.113.194:38169)
0806 04:48:16.796375 (+ 30267us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:16.796385 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:16.796420 (+ 35us) server_negotiation.cc:407] Connection header received
0806 04:48:16.796538 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:16.796548 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:16.796882 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:16.798128 (+ 1246us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:16.798494 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.800002 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.802203 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.803196 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.803349 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:16.803549 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:16.805197 (+ 1648us) server_negotiation.cc:299] Negotiation successful
0806 04:48:16.805365 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30055,"thread_start_us":30920,"threads_started":1}
I20260806 04:48:16.818351 21187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:16.767437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:35433 (local address 127.0.0.1:52938)
0806 04:48:16.804883 (+ 37446us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:16.804903 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:16.805019 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:16.811764 (+ 6745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:16.811769 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:16.811795 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:16.811978 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:16.811988 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.814143 (+ 2155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.814148 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:16.815887 (+ 1739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:16.815902 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.817667 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.817673 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:16.817845 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:16.817879 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 04:48:16.817940 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 04:48:16.818068 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37350,"thread_start_us":48981,"threads_started":1}
I20260806 04:48:16.819857 21190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:16.767991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52938 (local address 127.7.113.195:35433)
0806 04:48:16.811196 (+ 43205us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:16.811205 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:16.811242 (+ 37us) server_negotiation.cc:407] Connection header received
0806 04:48:16.811337 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:16.811344 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:16.811556 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:16.812148 (+ 592us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:16.812462 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.813996 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.816078 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.817488 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.819029 (+ 1541us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:16.819273 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:16.819342 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 04:48:16.819497 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43014,"thread_start_us":48618,"threads_started":1}
I20260806 04:48:16.821432 20967 tablet_service.cc:1467] Processing CreateTablet for tablet 3066d2d44f7c410a98618a4f0ee228b0 (DEFAULT_TABLE table=test-table [id=ada1dac5feed4f46a3ab5a30e5ebae40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:48:16.823138 20967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3066d2d44f7c410a98618a4f0ee228b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:16.823547 21103 tablet_service.cc:1467] Processing CreateTablet for tablet 3066d2d44f7c410a98618a4f0ee228b0 (DEFAULT_TABLE table=test-table [id=ada1dac5feed4f46a3ab5a30e5ebae40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:48:16.824903 21103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3066d2d44f7c410a98618a4f0ee228b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:16.835477 21192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:16.780996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38054 (local address 127.7.113.193:41591)
0806 04:48:16.788875 (+ 7879us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:16.788888 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:16.810578 (+ 21690us) server_negotiation.cc:407] Connection header received
0806 04:48:16.810787 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:16.810799 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:16.811125 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:16.811361 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:16.819466 (+ 8105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.821064 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.832428 (+ 11364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.833959 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.834073 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:16.834327 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:16.834965 (+ 638us) server_negotiation.cc:299] Negotiation successful
0806 04:48:16.835149 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7641,"thread_start_us":7453,"threads_started":1}
I20260806 04:48:16.836155 21189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:16.780587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:41591 (local address 127.0.0.1:38054)
0806 04:48:16.810432 (+ 29845us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:16.810454 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:16.810611 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:16.818445 (+ 7834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:16.818450 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:16.818476 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:16.819255 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:16.819269 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.821273 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.821278 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:16.823299 (+ 2021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:16.823326 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:16.834547 (+ 11221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:16.834554 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:16.834737 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:16.834779 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 04:48:16.835681 (+ 902us) client_negotiation.cc:240] Negotiation successful
0806 04:48:16.835833 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29723,"thread_start_us":36413,"threads_started":1}
I20260806 04:48:16.839962 20821 tablet_service.cc:1467] Processing CreateTablet for tablet 3066d2d44f7c410a98618a4f0ee228b0 (DEFAULT_TABLE table=test-table [id=ada1dac5feed4f46a3ab5a30e5ebae40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:48:16.841466 20821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3066d2d44f7c410a98618a4f0ee228b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:16.842418 21193 tablet_bootstrap.cc:492] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f: Bootstrap starting.
I20260806 04:48:16.846053 21193 tablet_bootstrap.cc:654] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:16.847373 21193 log.cc:824] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:16.856951 21195 tablet_bootstrap.cc:492] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6: Bootstrap starting.
I20260806 04:48:16.868191 21195 tablet_bootstrap.cc:654] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:16.869055 21196 tablet_bootstrap.cc:492] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994: Bootstrap starting.
I20260806 04:48:16.869496 21195 log.cc:824] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:16.871685 21193 tablet_bootstrap.cc:492] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f: No bootstrap required, opened a new log
I20260806 04:48:16.872038 21193 ts_tablet_manager.cc:1397] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.011s
I20260806 04:48:16.873258 21196 tablet_bootstrap.cc:654] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:16.874542 21196 log.cc:824] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:16.885152 21193 raft_consensus.cc:348] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38169 } } peers { permanent_uuid: "20e2b8c622c0484a9b6789a788d2928f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 35433 } } peers { permanent_uuid: "5ef94e93bca1493582b976bc8e464994" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41591 } }
I20260806 04:48:16.888070 21195 tablet_bootstrap.cc:492] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6: No bootstrap required, opened a new log
I20260806 04:48:16.888429 21195 ts_tablet_manager.cc:1397] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.004s
I20260806 04:48:16.894699 21193 raft_consensus.cc:374] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:16.894857 21193 raft_consensus.cc:729] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e2b8c622c0484a9b6789a788d2928f, State: Initialized, Role: FOLLOWER
I20260806 04:48:16.895663 21193 consensus_queue.cc:260] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38169 } } peers { permanent_uuid: "20e2b8c622c0484a9b6789a788d2928f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 35433 } } peers { permanent_uuid: "5ef94e93bca1493582b976bc8e464994" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41591 } }
I20260806 04:48:16.900560 21195 raft_consensus.cc:348] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38169 } } peers { permanent_uuid: "20e2b8c622c0484a9b6789a788d2928f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 35433 } } peers { permanent_uuid: "5ef94e93bca1493582b976bc8e464994" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41591 } }
I20260806 04:48:16.902980 21196 tablet_bootstrap.cc:492] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994: No bootstrap required, opened a new log
I20260806 04:48:16.903347 21196 ts_tablet_manager.cc:1397] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994: Time spent bootstrapping tablet: real 0.035s user 0.015s sys 0.013s
I20260806 04:48:16.904938 21193 ts_tablet_manager.cc:1428] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f: Time spent starting tablet: real 0.033s user 0.016s sys 0.003s
I20260806 04:48:16.905411 21171 heartbeater.cc:503] Master 127.7.113.254:39897 was elected leader, sending a full tablet report...
I20260806 04:48:16.912392 21195 raft_consensus.cc:374] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:16.912601 21195 raft_consensus.cc:729] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7826bcf0eb0a4523afa27cff7ccd23c6, State: Initialized, Role: FOLLOWER
I20260806 04:48:16.913442 21195 consensus_queue.cc:260] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38169 } } peers { permanent_uuid: "20e2b8c622c0484a9b6789a788d2928f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 35433 } } peers { permanent_uuid: "5ef94e93bca1493582b976bc8e464994" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41591 } }
I20260806 04:48:16.918145 21196 raft_consensus.cc:348] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38169 } } peers { permanent_uuid: "20e2b8c622c0484a9b6789a788d2928f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 35433 } } peers { permanent_uuid: "5ef94e93bca1493582b976bc8e464994" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41591 } }
I20260806 04:48:16.918715 21196 raft_consensus.cc:374] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:16.918865 21196 raft_consensus.cc:729] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ef94e93bca1493582b976bc8e464994, State: Initialized, Role: FOLLOWER
I20260806 04:48:16.919437 21195 ts_tablet_manager.cc:1428] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6: Time spent starting tablet: real 0.031s user 0.014s sys 0.001s
I20260806 04:48:16.919860 21033 heartbeater.cc:503] Master 127.7.113.254:39897 was elected leader, sending a full tablet report...
I20260806 04:48:16.919677 21196 consensus_queue.cc:260] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38169 } } peers { permanent_uuid: "20e2b8c622c0484a9b6789a788d2928f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 35433 } } peers { permanent_uuid: "5ef94e93bca1493582b976bc8e464994" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41591 } }
I20260806 04:48:16.927064 20887 heartbeater.cc:503] Master 127.7.113.254:39897 was elected leader, sending a full tablet report...
I20260806 04:48:16.927668 21196 ts_tablet_manager.cc:1428] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994: Time spent starting tablet: real 0.024s user 0.016s sys 0.001s
W20260806 04:48:16.986846 21034 tablet.cc:2369] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:48:17.052207 21201 raft_consensus.cc:482] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:48:17.052589 21201 raft_consensus.cc:504] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38169 } } peers { permanent_uuid: "20e2b8c622c0484a9b6789a788d2928f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 35433 } } peers { permanent_uuid: "5ef94e93bca1493582b976bc8e464994" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41591 } }
I20260806 04:48:17.054530 21201 leader_election.cc:288] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7826bcf0eb0a4523afa27cff7ccd23c6 (127.7.113.194:38169), 20e2b8c622c0484a9b6789a788d2928f (127.7.113.195:35433)
I20260806 04:48:17.062419 21190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.055097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:59013 (local address 127.7.113.195:35433)
0806 04:48:17.055390 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:17.055399 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:17.055932 (+ 533us) server_negotiation.cc:407] Connection header received
0806 04:48:17.056189 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:17.056193 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:17.056304 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:17.056403 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:17.057362 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.058084 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.060080 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.061470 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.061580 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:17.061629 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:17.062107 (+ 478us) server_negotiation.cc:299] Negotiation successful
0806 04:48:17.062198 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260806 04:48:17.062546 21209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.054921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:35433 (local address 127.7.113.193:59013)
0806 04:48:17.055770 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:17.055803 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:17.056021 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:17.056446 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:17.056454 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:17.056482 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:17.057221 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:17.057237 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.058225 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.058231 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:17.059902 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:17.059919 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.061698 (+ 1779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.061704 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:17.061920 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:17.061955 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 04:48:17.062059 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 04:48:17.062211 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":392,"threads_started":1}
I20260806 04:48:17.063902 21188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.055104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:35181 (local address 127.7.113.194:38169)
0806 04:48:17.055588 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:17.055597 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:17.056288 (+ 691us) server_negotiation.cc:407] Connection header received
0806 04:48:17.056518 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:17.056524 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:17.056668 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:17.056763 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:17.057739 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.058493 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.061327 (+ 2834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.062768 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.062988 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:17.063055 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:17.063336 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 04:48:17.063464 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320}
I20260806 04:48:17.063653 21123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3066d2d44f7c410a98618a4f0ee228b0" candidate_uuid: "5ef94e93bca1493582b976bc8e464994" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e2b8c622c0484a9b6789a788d2928f" is_pre_election: true
I20260806 04:48:17.064047 21210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.054921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:38169 (local address 127.7.113.193:35181)
0806 04:48:17.056155 (+ 1234us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:17.056172 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:17.056325 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:17.056969 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:17.056976 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:17.057019 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:17.057568 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:17.057577 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.058672 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.058680 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:17.061168 (+ 2488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:17.061183 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.063062 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.063067 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:17.063181 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:17.063204 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 04:48:17.063310 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 04:48:17.063441 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1105,"mutex_wait_us":64,"thread_start_us":873,"threads_started":1}
I20260806 04:48:17.064008 21200 raft_consensus.cc:482] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:48:17.064543 21123 raft_consensus.cc:2454] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ef94e93bca1493582b976bc8e464994 in term 0.
I20260806 04:48:17.064642 21200 raft_consensus.cc:504] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38169 } } peers { permanent_uuid: "20e2b8c622c0484a9b6789a788d2928f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 35433 } } peers { permanent_uuid: "5ef94e93bca1493582b976bc8e464994" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41591 } }
I20260806 04:48:17.065196 20774 leader_election.cc:302] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e2b8c622c0484a9b6789a788d2928f, 5ef94e93bca1493582b976bc8e464994; no voters:
I20260806 04:48:17.065276 20987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3066d2d44f7c410a98618a4f0ee228b0" candidate_uuid: "5ef94e93bca1493582b976bc8e464994" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" is_pre_election: true
I20260806 04:48:17.065670 21201 raft_consensus.cc:2781] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:48:17.065810 21201 raft_consensus.cc:482] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:48:17.065922 21201 raft_consensus.cc:3037] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:17.065934 20987 raft_consensus.cc:2454] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ef94e93bca1493582b976bc8e464994 in term 0.
I20260806 04:48:17.066725 21200 leader_election.cc:288] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e2b8c622c0484a9b6789a788d2928f (127.7.113.195:35433), 5ef94e93bca1493582b976bc8e464994 (127.7.113.193:41591)
I20260806 04:48:17.070941 21201 raft_consensus.cc:504] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38169 } } peers { permanent_uuid: "20e2b8c622c0484a9b6789a788d2928f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 35433 } } peers { permanent_uuid: "5ef94e93bca1493582b976bc8e464994" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41591 } }
I20260806 04:48:17.072036 21201 leader_election.cc:288] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [CANDIDATE]: Term 1 election: Requested vote from peers 7826bcf0eb0a4523afa27cff7ccd23c6 (127.7.113.194:38169), 20e2b8c622c0484a9b6789a788d2928f (127.7.113.195:35433)
I20260806 04:48:17.072340 21123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3066d2d44f7c410a98618a4f0ee228b0" candidate_uuid: "5ef94e93bca1493582b976bc8e464994" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e2b8c622c0484a9b6789a788d2928f"
I20260806 04:48:17.072456 20987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3066d2d44f7c410a98618a4f0ee228b0" candidate_uuid: "5ef94e93bca1493582b976bc8e464994" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6"
I20260806 04:48:17.072584 21123 raft_consensus.cc:3037] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:17.072679 20987 raft_consensus.cc:3037] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:17.076333 21123 raft_consensus.cc:2454] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ef94e93bca1493582b976bc8e464994 in term 1.
I20260806 04:48:17.076763 20774 leader_election.cc:302] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e2b8c622c0484a9b6789a788d2928f, 5ef94e93bca1493582b976bc8e464994; no voters:
I20260806 04:48:17.076962 20987 raft_consensus.cc:2454] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ef94e93bca1493582b976bc8e464994 in term 1.
I20260806 04:48:17.077195 21201 raft_consensus.cc:2781] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:48:17.079747 21192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.067235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:54673 (local address 127.7.113.193:41591)
0806 04:48:17.067467 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:17.067475 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:17.072176 (+ 4701us) server_negotiation.cc:407] Connection header received
0806 04:48:17.072493 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:17.072497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:17.072607 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:17.072676 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:17.074029 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.075129 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.077929 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.078799 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.079025 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:17.079093 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:17.079383 (+ 290us) server_negotiation.cc:299] Negotiation successful
0806 04:48:17.079504 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 04:48:17.079924 21212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.067249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:41591 (local address 127.7.113.194:54673)
0806 04:48:17.072091 (+ 4842us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:17.072108 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:17.072314 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:17.072887 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:17.072891 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:17.072915 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:17.073826 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:17.073839 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.075324 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.075330 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:17.077770 (+ 2440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:17.077781 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.079039 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.079045 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:17.079213 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:17.079236 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 04:48:17.079360 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 04:48:17.079492 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4627,"thread_start_us":4415,"threads_started":1}
I20260806 04:48:17.080516 21190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.067283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:54741 (local address 127.7.113.195:35433)
0806 04:48:17.067501 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:17.067508 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:17.071112 (+ 3604us) server_negotiation.cc:407] Connection header received
0806 04:48:17.071319 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:17.071325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:17.071400 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:17.071507 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:17.072976 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.074184 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.077251 (+ 3067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.078910 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.079088 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:17.079193 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:17.079948 (+ 755us) server_negotiation.cc:299] Negotiation successful
0806 04:48:17.080129 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 04:48:17.081039 20842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3066d2d44f7c410a98618a4f0ee228b0" candidate_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ef94e93bca1493582b976bc8e464994" is_pre_election: true
I20260806 04:48:17.081432 21211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.066883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:35433 (local address 127.7.113.194:54741)
0806 04:48:17.071014 (+ 4131us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:17.071028 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:17.071189 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:17.071694 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:17.071705 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:17.071737 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:17.072793 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:17.072807 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.074386 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.074393 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:17.077060 (+ 2667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:17.077076 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.079460 (+ 2384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.079469 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:17.079721 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:17.079769 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 04:48:17.080705 (+ 936us) client_negotiation.cc:240] Negotiation successful
0806 04:48:17.080889 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4000,"thread_start_us":3698,"threads_started":1}
I20260806 04:48:17.082254 21123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3066d2d44f7c410a98618a4f0ee228b0" candidate_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e2b8c622c0484a9b6789a788d2928f" is_pre_election: true
I20260806 04:48:17.082690 21123 raft_consensus.cc:2379] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7826bcf0eb0a4523afa27cff7ccd23c6 in current term 1: Already voted for candidate 5ef94e93bca1493582b976bc8e464994 in this term.
I20260806 04:48:17.083638 21201 raft_consensus.cc:686] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [term 1 LEADER]: Becoming Leader. State: Replica: 5ef94e93bca1493582b976bc8e464994, State: Running, Role: LEADER
I20260806 04:48:17.084045 21201 consensus_queue.cc:237] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38169 } } peers { permanent_uuid: "20e2b8c622c0484a9b6789a788d2928f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 35433 } } peers { permanent_uuid: "5ef94e93bca1493582b976bc8e464994" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41591 } }
I20260806 04:48:17.089388 20919 leader_election.cc:302] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7826bcf0eb0a4523afa27cff7ccd23c6; no voters: 20e2b8c622c0484a9b6789a788d2928f, 5ef94e93bca1493582b976bc8e464994
I20260806 04:48:17.089811 21200 raft_consensus.cc:2726] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 04:48:17.090229 20687 catalog_manager.cc:5495] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ef94e93bca1493582b976bc8e464994 (127.7.113.193). New cstate: current_term: 1 leader_uuid: "5ef94e93bca1493582b976bc8e464994" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e2b8c622c0484a9b6789a788d2928f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ef94e93bca1493582b976bc8e464994" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41591 } health_report { overall_health: HEALTHY } } }
W20260806 04:48:17.125375 20888 tablet.cc:2369] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:48:17.125501 21172 tablet.cc:2369] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:48:17.143622 21192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.138070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38064 (local address 127.7.113.193:41591)
0806 04:48:17.138243 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:17.138247 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:17.138265 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:48:17.138346 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:17.138350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:17.138433 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:17.138551 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:48:17.138954 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.139737 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.141196 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.141933 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.142039 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:17.142485 (+ 446us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:48:17.142981 (+ 496us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:48:17.143089 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:17.143201 (+ 112us) server_negotiation.cc:299] Negotiation successful
0806 04:48:17.143313 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 04:48:17.151779 21123 raft_consensus.cc:1261] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f [term 1 FOLLOWER]: Refusing update from remote peer 5ef94e93bca1493582b976bc8e464994: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:48:17.151906 20987 raft_consensus.cc:1261] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [term 1 FOLLOWER]: Refusing update from remote peer 5ef94e93bca1493582b976bc8e464994: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:48:17.152808 21213 consensus_queue.cc:1035] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7826bcf0eb0a4523afa27cff7ccd23c6" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:48:17.153192 21201 consensus_queue.cc:1035] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e2b8c622c0484a9b6789a788d2928f" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:48:17.183422 20687 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:48:17.183652 20687 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:48:17.187467 20687 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e88fa8287da8412fac0f0e11212a6467: Sending DeleteTablet for 3 replicas of tablet 3066d2d44f7c410a98618a4f0ee228b0
I20260806 04:48:17.188868 20967 tablet_service.cc:1514] Processing DeleteTablet for tablet 3066d2d44f7c410a98618a4f0ee228b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:48:17 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:34788
I20260806 04:48:17.188875 20821 tablet_service.cc:1514] Processing DeleteTablet for tablet 3066d2d44f7c410a98618a4f0ee228b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:48:17 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:38054
I20260806 04:48:17.189769 21103 tablet_service.cc:1514] Processing DeleteTablet for tablet 3066d2d44f7c410a98618a4f0ee228b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:48:17 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:52938
I20260806 04:48:17.189962 21227 tablet_replica.cc:330] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6: stopping tablet replica
I20260806 04:48:17.190474 21227 raft_consensus.cc:2229] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:48:17.190801 21229 tablet_replica.cc:330] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f: stopping tablet replica
I20260806 04:48:17.191053 21227 raft_consensus.cc:2258] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:48:17.191259 21229 raft_consensus.cc:2229] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:48:17.191772 21229 raft_consensus.cc:2258] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:48:17.192798 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 20725
I20260806 04:48:17.199836 21227 ts_tablet_manager.cc:1905] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:48:17.201778 21229 ts_tablet_manager.cc:1905] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:48:17.209331 21229 ts_tablet_manager.cc:1918] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:48:17.209573 21229 log.cc:1196] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/3066d2d44f7c410a98618a4f0ee228b0
I20260806 04:48:17.210255 21229 ts_tablet_manager.cc:1939] T 3066d2d44f7c410a98618a4f0ee228b0 P 20e2b8c622c0484a9b6789a788d2928f: Deleting consensus metadata
I20260806 04:48:17.211860 21228 tablet_replica.cc:330] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994: stopping tablet replica
I20260806 04:48:17.212446 21228 raft_consensus.cc:2229] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:48:17.212625 20671 catalog_manager.cc:4841] TS 20e2b8c622c0484a9b6789a788d2928f (127.7.113.195:35433): tablet 3066d2d44f7c410a98618a4f0ee228b0 (table test-table [id=ada1dac5feed4f46a3ab5a30e5ebae40]) successfully deleted
I20260806 04:48:17.213169 21228 raft_consensus.cc:2258] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:48:17.213647 21227 ts_tablet_manager.cc:1918] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:48:17.213876 21227 log.cc:1196] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/3066d2d44f7c410a98618a4f0ee228b0
I20260806 04:48:17.214572 21227 ts_tablet_manager.cc:1939] T 3066d2d44f7c410a98618a4f0ee228b0 P 7826bcf0eb0a4523afa27cff7ccd23c6: Deleting consensus metadata
I20260806 04:48:17.215960 21228 ts_tablet_manager.cc:1905] T 3066d2d44f7c410a98618a4f0ee228b0 P 5ef94e93bca1493582b976bc8e464994: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:48:17.216480 20673 catalog_manager.cc:4841] TS 7826bcf0eb0a4523afa27cff7ccd23c6 (127.7.113.194:38169): tablet 3066d2d44f7c410a98618a4f0ee228b0 (table test-table [id=ada1dac5feed4f46a3ab5a30e5ebae40]) successfully deleted
I20260806 04:48:17.219558 21192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.196641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38080 (local address 127.7.113.193:41591)
0806 04:48:17.196878 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:17.196887 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:17.201074 (+ 4187us) server_negotiation.cc:407] Connection header received
0806 04:48:17.201372 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:17.201377 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:17.201463 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:17.201538 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:17.203411 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.204604 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.206513 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.207240 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.207336 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:17.211261 (+ 3925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:17.211275 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:17.211305 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:17.211370 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:17.216136 (+ 4766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:17.217098 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:17.217113 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:17.217117 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:17.217326 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:17.217787 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:17.217792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:17.217795 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:17.218336 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:17.218664 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:17.218964 (+ 300us) server_negotiation.cc:299] Negotiation successful
0806 04:48:17.219218 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 04:48:17.220520 20882 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:17.317174 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 20725
I20260806 04:48:17.336817 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 20891
W20260806 04:48:17.336899 20673 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.113.193:41591 (error 108)
I20260806 04:48:17.340975 21233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.338220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:41591 (local address 127.0.0.1:38096)
0806 04:48:17.340610 (+ 2390us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:17.340744 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:41591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2257,"thread_start_us":2198,"threads_started":1}
W20260806 04:48:17.341223 20673 catalog_manager.cc:4584] TS 5ef94e93bca1493582b976bc8e464994 (127.7.113.193:41591): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3066d2d44f7c410a98618a4f0ee228b0: Network error: Client connection negotiation failed: client connection to 127.7.113.193:41591: connect: Connection refused (error 111)
I20260806 04:48:17.350826 21188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.337696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34800 (local address 127.7.113.194:38169)
0806 04:48:17.337888 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:17.337894 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:17.337956 (+ 62us) server_negotiation.cc:407] Connection header received
0806 04:48:17.338178 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:17.338182 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:17.338242 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:17.338321 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:17.340579 (+ 2258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.341559 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.342767 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.343134 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.343221 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:17.345607 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:17.345621 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:17.345634 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:17.345669 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:17.348565 (+ 2896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:17.349166 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:17.349172 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:17.349174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:17.349296 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:17.349613 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:17.349616 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:17.349618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:17.349946 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:17.350158 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:17.350407 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 04:48:17.350553 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 04:48:17.351488 21028 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:17.394681 21233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.394250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:41591 (local address 127.0.0.1:38098)
0806 04:48:17.394459 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:17.394548 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:41591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 04:48:17.395684 21233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.395345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:41591 (local address 127.0.0.1:38112)
0806 04:48:17.395495 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:17.395568 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:41591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 04:48:17.441665 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 20891
I20260806 04:48:17.456425 21233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.455862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:41591 (local address 127.0.0.1:38122)
0806 04:48:17.456101 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:17.456200 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:41591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260806 04:48:17.457443 21233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.457090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:41591 (local address 127.0.0.1:38124)
0806 04:48:17.457243 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:17.457305 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:41591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 04:48:17.460536 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 21037
I20260806 04:48:17.472919 21190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.461226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52954 (local address 127.7.113.195:35433)
0806 04:48:17.461380 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:17.461385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:17.461402 (+ 17us) server_negotiation.cc:407] Connection header received
0806 04:48:17.461565 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:17.461568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:17.461643 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:17.461732 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:17.463014 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.463675 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.464982 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:17.465386 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:17.465477 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:17.467943 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:17.467956 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:17.467972 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:17.468003 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:17.470648 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:17.471268 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:17.471274 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:17.471276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:17.471397 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:17.471696 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:17.471699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:17.471701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:17.472022 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:17.472238 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:17.472535 (+ 297us) server_negotiation.cc:299] Negotiation successful
0806 04:48:17.472683 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 04:48:17.473521 21166 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:17.538714 21233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.538172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:41591 (local address 127.0.0.1:38132)
0806 04:48:17.538415 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:17.538531 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:41591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260806 04:48:17.539862 21233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:17.539373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:41591 (local address 127.0.0.1:38138)
0806 04:48:17.539600 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:17.539695 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:41591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260806 04:48:17.560946 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 21037
I20260806 04:48:17.580423 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 20654
I20260806 04:48:17.581598 20717 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:17.693239 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 20654
I20260806 04:48:17.712841 7623 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 04:48:18.058329 7623 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 04:48:18.058548 7623 mini_ranger.cc:66] Stopping Ranger...
I20260806 04:48:18.403740 7623 mini_ranger.cc:68] Stopped Ranger
2026-08-06 04:48:18.404 UTC [19691] LOG: received smart shutdown request
2026-08-06 04:48:18.406 UTC [19691] LOG: background worker "logical replication launcher" (PID 19700) exited with exit code 1
2026-08-06 04:48:18.407 UTC [19695] LOG: shutting down
2026-08-06 04:48:18.574 UTC [19691] LOG: database system is shut down
2026-08-06T04:48:18Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (50745 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:48:18 dist-test-slave-0b58 krb5kdc[21245](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:48:18 dist-test-slave-0b58 krb5kdc[21245](info): set up 2 sockets
Aug 06 04:48:18 dist-test-slave-0b58 krb5kdc[21245](info): commencing operation
krb5kdc: starting...
W20260806 04:48:19.811179 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.003s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:48:19 dist-test-slave-0b58 krb5kdc[21245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:48:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:48:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:48:20.061951 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:44403
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:35927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:44403,127.7.113.253:42983,127.7.113.252:45625
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:20.396270 21258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:20.396530 21258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:20.396692 21258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:20.403791 21258 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:48:20.403892 21258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:20.403939 21258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:20.404026 21258 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:48:20.404116 21258 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:48:20.413888 21258 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:35927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:44403,127.7.113.253:42983,127.7.113.252:45625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:44403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:20.415307 21258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:20.416692 21258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:20.428438 21263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:20.428484 21264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:20.428532 21267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:20.429385 21258 server_base.cc:1034] running on GCE node
I20260806 04:48:20.430088 21258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:20.431427 21258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:20.432658 21258 hybrid_clock.cc:648] HybridClock initialized: now 1785991700432615 us; error 53 us; skew 500 ppm
I20260806 04:48:20.432981 21258 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:20 dist-test-slave-0b58 krb5kdc[21245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991700, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:20.436045 21258 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:48:20.437425 21258 webserver.cc:460] Webserver started at http://127.7.113.254:45885/ using document root <none> and password file <none>
I20260806 04:48:20.438047 21258 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:20.438141 21258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:20.438372 21258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:48:20.441705 21258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "82b96813c4a14f1991105c8c7c5812a8"
format_stamp: "Formatted at 2026-08-06 04:48:20 on dist-test-slave-0b58"
server_key: "887301acf7b65f2cab8d06167850da64"
server_key_iv: "df41e9e6b58424ab04c3b2ce041e2b96"
server_key_version: "encryptionkey@0"
I20260806 04:48:20.442430 21258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "82b96813c4a14f1991105c8c7c5812a8"
format_stamp: "Formatted at 2026-08-06 04:48:20 on dist-test-slave-0b58"
server_key: "887301acf7b65f2cab8d06167850da64"
server_key_iv: "df41e9e6b58424ab04c3b2ce041e2b96"
server_key_version: "encryptionkey@0"
I20260806 04:48:20.447199 21258 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260806 04:48:20.450369 21274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:20.451557 21258 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260806 04:48:20.451738 21258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "82b96813c4a14f1991105c8c7c5812a8"
format_stamp: "Formatted at 2026-08-06 04:48:20 on dist-test-slave-0b58"
server_key: "887301acf7b65f2cab8d06167850da64"
server_key_iv: "df41e9e6b58424ab04c3b2ce041e2b96"
server_key_version: "encryptionkey@0"
I20260806 04:48:20.451918 21258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:20.489244 21258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:20.493571 21258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:20.493867 21258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:20.512347 21258 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:44403
I20260806 04:48:20.512431 21325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:44403 every 8 connection(s)
I20260806 04:48:20.513640 21258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:48:20.516214 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 21258
I20260806 04:48:20.516466 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:48:20.517150 7623 external_mini_cluster.cc:1428] Setting key a2592b86dd9c750681a72c3c527af04e
I20260806 04:48:20.517277 21326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:20.523483 21326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:48:20 dist-test-slave-0b58 krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991700, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.113.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.253@KRBTEST.COM" created.
I20260806 04:48:20.547869 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:20.526433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:44403 (local address 127.0.0.1:49478)
0806 04:48:20.527325 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:20.527384 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:20.530230 (+ 2846us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:20.531012 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:20.531022 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:20.531815 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:20.532356 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:20.532383 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:20.533995 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:20.534003 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:20.535929 (+ 1926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:20.535959 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:20.536963 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:20.536973 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:20.537192 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:20.537869 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:20.537913 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:20.540600 (+ 2687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:20.543767 (+ 3167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:20.543777 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:20.543789 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:20.544196 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:20.544596 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:20.544601 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:20.544605 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:20.544746 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:20.545457 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:20.545465 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:20.545678 (+ 213us) client_negotiation.cc:769] Sending connection context
0806 04:48:20.545909 (+ 231us) client_negotiation.cc:240] Negotiation successful
0806 04:48:20.546560 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"mutex_wait_us":213,"thread_start_us":379,"threads_started":1}
I20260806 04:48:20.547894 21330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:20.526433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49478 (local address 127.7.113.254:44403)
0806 04:48:20.528242 (+ 1809us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:20.528248 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:20.528342 (+ 94us) server_negotiation.cc:407] Connection header received
0806 04:48:20.530578 (+ 2236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:20.530584 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:20.530773 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:20.530922 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:20.532565 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:20.533803 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:20.536112 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:20.536708 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:20.536834 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:20.540829 (+ 3995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:20.540836 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:20.540848 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:20.540875 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:20.543629 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:20.544356 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:20.544362 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:20.544364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:20.544493 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:20.544860 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:20.544865 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:20.544868 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:20.545306 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:20.545515 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:20.546035 (+ 520us) server_negotiation.cc:299] Negotiation successful
0806 04:48:20.546448 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":1630,"spinlock_wait_cycles":48000,"thread_start_us":1399,"threads_started":1}
I20260806 04:48:20.551226 21326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } has no permanent_uuid. Determining permanent_uuid...
I20260806 04:48:20.552452 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:20.552009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:42983 (local address 127.0.0.1:44806)
0806 04:48:20.552181 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:20.552337 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260806 04:48:20.552712 21277 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
I20260806 04:48:20.554217 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:20.553883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:42983 (local address 127.0.0.1:44814)
0806 04:48:20.554046 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:20.554107 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260806 04:48:20.554405 21326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:42983: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.253.keytab.
Entry for principal kudu/127.7.113.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.253.keytab.
I20260806 04:48:20.577777 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.253:42983
--webserver_interface=127.7.113.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.253.keytab
--principal=kudu/127.7.113.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:35927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:44403,127.7.113.253:42983,127.7.113.252:45625
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:48:20.603783 21326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } attempt: 1
I20260806 04:48:20.605041 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:20.604507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:42983 (local address 127.0.0.1:33006)
0806 04:48:20.604721 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:20.604856 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 04:48:20.606047 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:20.605665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:42983 (local address 127.0.0.1:33008)
0806 04:48:20.605813 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:20.605899 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 04:48:20.606262 21326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:42983: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
I20260806 04:48:20.674542 21326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } attempt: 2
I20260806 04:48:20.675947 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:20.675347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:42983 (local address 127.0.0.1:33016)
0806 04:48:20.675639 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:20.675756 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260806 04:48:20.677100 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:20.676677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:42983 (local address 127.0.0.1:33032)
0806 04:48:20.676836 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:20.676945 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 04:48:20.677340 21326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:42983: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
I20260806 04:48:20.768689 21326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } attempt: 3
I20260806 04:48:20.770042 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:20.769405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:42983 (local address 127.0.0.1:33036)
0806 04:48:20.769673 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:20.769835 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260806 04:48:20.771216 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:20.770803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:42983 (local address 127.0.0.1:33042)
0806 04:48:20.770969 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:20.771055 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260806 04:48:20.771417 21326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:42983: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
W20260806 04:48:20.907445 21333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:20.907706 21333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:20.907794 21333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260806 04:48:20.914697 21326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } attempt: 4
W20260806 04:48:20.915084 21333 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:48:20.915218 21333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:20.915308 21333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:20.915413 21333 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:48:20.915500 21333 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:48:20.916059 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:20.915430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:42983 (local address 127.0.0.1:33048)
0806 04:48:20.915791 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:20.915898 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172}
I20260806 04:48:20.917106 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:20.916704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:42983 (local address 127.0.0.1:33064)
0806 04:48:20.916851 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:20.916953 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 04:48:20.917309 21326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:42983: Network error: Client connection negotiation failed: client connection to 127.7.113.253:42983: connect: Connection refused (error 111)
I20260806 04:48:20.925962 21333 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:35927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:44403,127.7.113.253:42983,127.7.113.252:45625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.253.keytab
--principal=kudu/127.7.113.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.253:42983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.113.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:20.927160 21333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:20.928509 21333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:20.940104 21338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:20.940055 21341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:20.940147 21339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:20.941824 21333 server_base.cc:1034] running on GCE node
I20260806 04:48:20.942659 21333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:20.943981 21333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:20.945212 21333 hybrid_clock.cc:648] HybridClock initialized: now 1785991700945168 us; error 53 us; skew 500 ppm
I20260806 04:48:20.945561 21333 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:20 dist-test-slave-0b58 krb5kdc[21245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991700, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:20.948629 21333 init.cc:377] Logged in from keytab as kudu/127.7.113.253@KRBTEST.COM (short username kudu)
I20260806 04:48:20.950019 21333 webserver.cc:460] Webserver started at http://127.7.113.253:36861/ using document root <none> and password file <none>
I20260806 04:48:20.950650 21333 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:20.950747 21333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:20.950994 21333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:48:20.953691 21333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/data/instance:
uuid: "ad102e14959447b488533bcc6a04e010"
format_stamp: "Formatted at 2026-08-06 04:48:20 on dist-test-slave-0b58"
server_key: "eb4971804690a004bcdf2e3449d8e59c"
server_key_iv: "dfcb38dd898d2bc0e4f14ca3ac8100c4"
server_key_version: "encryptionkey@0"
I20260806 04:48:20.954387 21333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/wal/instance:
uuid: "ad102e14959447b488533bcc6a04e010"
format_stamp: "Formatted at 2026-08-06 04:48:20 on dist-test-slave-0b58"
server_key: "eb4971804690a004bcdf2e3449d8e59c"
server_key_iv: "dfcb38dd898d2bc0e4f14ca3ac8100c4"
server_key_version: "encryptionkey@0"
I20260806 04:48:20.959049 21333 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260806 04:48:20.962133 21348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:20.963321 21333 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 04:48:20.963474 21333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/wal
uuid: "ad102e14959447b488533bcc6a04e010"
format_stamp: "Formatted at 2026-08-06 04:48:20 on dist-test-slave-0b58"
server_key: "eb4971804690a004bcdf2e3449d8e59c"
server_key_iv: "dfcb38dd898d2bc0e4f14ca3ac8100c4"
server_key_version: "encryptionkey@0"
I20260806 04:48:20.963670 21333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:20.978686 21333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:20.982435 21333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:20.982703 21333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:21.000474 21333 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.253:42983
I20260806 04:48:21.000497 21401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.253:42983 every 8 connection(s)
I20260806 04:48:21.001760 21333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/data/info.pb
I20260806 04:48:21.005188 21402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:21.011776 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 21333
I20260806 04:48:21.011979 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-1/wal/instance
I20260806 04:48:21.011462 21402 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } has no permanent_uuid. Determining permanent_uuid...
I20260806 04:48:21.012521 7623 external_mini_cluster.cc:1428] Setting key c1635baa6cba8a2e96f5041e63f2cfb6
Aug 06 04:48:21 dist-test-slave-0b58 krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991700, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.253@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:21.030517 21330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.014167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55956 (local address 127.7.113.254:44403)
0806 04:48:21.014353 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:21.014357 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:21.015494 (+ 1137us) server_negotiation.cc:407] Connection header received
0806 04:48:21.017312 (+ 1818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:21.017317 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:21.017404 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:21.017511 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:21.018889 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.019572 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.021111 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.021529 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.021663 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.025065 (+ 3402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:21.025070 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:21.025073 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:21.025104 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:21.027659 (+ 2555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.028381 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.028391 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.028394 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.028506 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.028923 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.028927 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.028932 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.029204 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:21.029369 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:21.029990 (+ 621us) server_negotiation.cc:299] Negotiation successful
0806 04:48:21.030208 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 04:48:21.031387 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.014622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:44403 (local address 127.0.0.1:55956)
0806 04:48:21.015341 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.015376 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:21.017051 (+ 1675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:21.017726 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:21.017734 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:21.018196 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:21.018721 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.018736 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.019734 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.019738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.020972 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.020983 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.021743 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.021750 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.021954 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.022582 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:21.022601 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:21.024855 (+ 2254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:21.027795 (+ 2940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.027806 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.027819 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.028227 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.028625 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.028629 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.028633 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.028804 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.029347 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:21.029354 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:21.029646 (+ 292us) client_negotiation.cc:769] Sending connection context
0806 04:48:21.029886 (+ 240us) client_negotiation.cc:240] Negotiation successful
0806 04:48:21.030331 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":327,"threads_started":1}
I20260806 04:48:21.033011 21402 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.7.113.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.252@KRBTEST.COM" created.
Aug 06 04:48:21 dist-test-slave-0b58 krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991700, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.253@KRBTEST.COM for kudu/127.7.113.253@KRBTEST.COM
I20260806 04:48:21.048650 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.033743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:42983 (local address 127.0.0.1:33074)
0806 04:48:21.033969 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.033994 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:21.034111 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:21.035096 (+ 985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:21.035106 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:21.035560 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:21.035775 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.035789 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.037206 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.037214 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.038207 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.038218 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.039043 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.039048 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.039314 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.039778 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:21.039793 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:21.041853 (+ 2060us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:21.045599 (+ 3746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.045606 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.045612 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.046179 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.046605 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.046612 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.046618 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.046811 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.047465 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:21.047472 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:21.047640 (+ 168us) client_negotiation.cc:769] Sending connection context
0806 04:48:21.047797 (+ 157us) client_negotiation.cc:240] Negotiation successful
0806 04:48:21.048104 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61,"mutex_wait_us":21}
I20260806 04:48:21.048805 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.034001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33074 (local address 127.7.113.253:42983)
0806 04:48:21.034659 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:21.034664 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:21.034687 (+ 23us) server_negotiation.cc:407] Connection header received
0806 04:48:21.034727 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:21.034732 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:21.034948 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:21.035057 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:21.035943 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.037073 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.038370 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.038905 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.039036 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.042050 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:21.042060 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:21.042071 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:21.042097 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:21.045463 (+ 3366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.046331 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.046340 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.046352 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.046494 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.046918 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.046925 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.046930 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.047329 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:21.047502 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:21.047916 (+ 414us) server_negotiation.cc:299] Negotiation successful
0806 04:48:21.048271 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":142,"server-negotiator.queue_time_us":516,"thread_start_us":389,"threads_started":1}
I20260806 04:48:21.051160 21402 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } has no permanent_uuid. Determining permanent_uuid...
I20260806 04:48:21.052178 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.051773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:35910)
0806 04:48:21.051941 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.052043 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 04:48:21.052419 21350 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
I20260806 04:48:21.053884 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.053577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:35926)
0806 04:48:21.053720 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.053794 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 04:48:21.054111 21402 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:45625: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.252.keytab.
Entry for principal kudu/127.7.113.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.252.keytab.
I20260806 04:48:21.071319 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.252:45625
--webserver_interface=127.7.113.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.252.keytab
--principal=kudu/127.7.113.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:35927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:44403,127.7.113.253:42983,127.7.113.252:45625
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:48:21.103379 21402 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } attempt: 1
I20260806 04:48:21.104691 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.104167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:35938)
0806 04:48:21.104417 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.104522 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260806 04:48:21.105643 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.105302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:35946)
0806 04:48:21.105470 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.105538 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 04:48:21.105881 21402 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:45625: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
I20260806 04:48:21.174185 21402 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } attempt: 2
I20260806 04:48:21.175379 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.174900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:35954)
0806 04:48:21.175097 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.175205 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 04:48:21.176411 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.175976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:35968)
0806 04:48:21.176147 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.176214 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260806 04:48:21.176620 21402 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:45625: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
I20260806 04:48:21.216593 21326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } attempt: 5
Aug 06 04:48:21 dist-test-slave-0b58 krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991700, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for kudu/127.7.113.253@KRBTEST.COM
I20260806 04:48:21.231431 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.217495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33076 (local address 127.7.113.253:42983)
0806 04:48:21.217677 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:21.217681 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:21.217700 (+ 19us) server_negotiation.cc:407] Connection header received
0806 04:48:21.217908 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:21.217912 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:21.217977 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:21.218070 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:21.219062 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.219759 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.221568 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.222034 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.222134 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.226087 (+ 3953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:21.226092 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:21.226096 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:21.226127 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:21.228915 (+ 2788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.229552 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.229564 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.229567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.229681 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.230050 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.230056 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.230060 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.230335 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:21.230491 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:21.230890 (+ 399us) server_negotiation.cc:299] Negotiation successful
0806 04:48:21.231116 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 04:48:21.231431 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.217363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:42983 (local address 127.0.0.1:33076)
0806 04:48:21.217589 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.217613 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:21.217740 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:21.218159 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:21.218163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:21.218657 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:21.218909 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.218922 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.219901 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.219906 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.221420 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.221435 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.222206 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.222215 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.222456 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.223118 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:21.223149 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:21.225887 (+ 2738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:21.229054 (+ 3167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.229059 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.229063 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.229426 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.229793 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.229800 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.229804 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.229941 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.230456 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:21.230460 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:21.230632 (+ 172us) client_negotiation.cc:769] Sending connection context
0806 04:48:21.230773 (+ 141us) client_negotiation.cc:240] Negotiation successful
0806 04:48:21.231042 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260806 04:48:21.232543 21326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } has no permanent_uuid. Determining permanent_uuid...
I20260806 04:48:21.233618 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.233227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:35984)
0806 04:48:21.233399 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.233480 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260806 04:48:21.234504 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.234198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:36000)
0806 04:48:21.234330 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.234391 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 04:48:21.234795 21326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:45625: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
I20260806 04:48:21.267870 21402 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } attempt: 3
I20260806 04:48:21.268914 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.268470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:36002)
0806 04:48:21.268648 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.268746 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260806 04:48:21.269908 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.269531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:36014)
0806 04:48:21.269731 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.269811 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
W20260806 04:48:21.270113 21402 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:45625: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
I20260806 04:48:21.286056 21326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } attempt: 1
I20260806 04:48:21.287142 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.286720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:36026)
0806 04:48:21.286894 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.286992 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260806 04:48:21.288079 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.287757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:36042)
0806 04:48:21.287913 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.287976 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 04:48:21.288352 21326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:45625: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
I20260806 04:48:21.356599 21326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } attempt: 2
I20260806 04:48:21.357776 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.357300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:36046)
0806 04:48:21.357487 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.357574 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 04:48:21.358788 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.358512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:36056)
0806 04:48:21.358632 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.358693 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 04:48:21.359062 21326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:45625: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
W20260806 04:48:21.398409 21409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:21.398639 21409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:21.398721 21409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:21.405856 21409 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:48:21.405943 21409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:21.405987 21409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:21.406061 21409 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:48:21.406163 21409 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:48:21.413368 21402 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } attempt: 4
I20260806 04:48:21.414513 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.414051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:36068)
0806 04:48:21.414278 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.414365 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 04:48:21.415359 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.415083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:36078)
0806 04:48:21.415208 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.415271 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 04:48:21.415532 21402 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:45625: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
I20260806 04:48:21.415583 21409 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:35927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:44403,127.7.113.253:42983,127.7.113.252:45625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.252.keytab
--principal=kudu/127.7.113.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.252:45625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.113.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:21.416862 21409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:21.418069 21409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:21.429488 21415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:21.429522 21414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:21.429744 21417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:21.430363 21409 server_base.cc:1034] running on GCE node
I20260806 04:48:21.431130 21409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:21.432411 21409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:21.433620 21409 hybrid_clock.cc:648] HybridClock initialized: now 1785991701433587 us; error 41 us; skew 500 ppm
I20260806 04:48:21.433928 21409 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:21 dist-test-slave-0b58 krb5kdc[21245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991701, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:21.436956 21409 init.cc:377] Logged in from keytab as kudu/127.7.113.252@KRBTEST.COM (short username kudu)
I20260806 04:48:21.438401 21409 webserver.cc:460] Webserver started at http://127.7.113.252:46199/ using document root <none> and password file <none>
I20260806 04:48:21.439059 21409 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:21.439196 21409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:21.439483 21409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:48:21.442284 21409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/data/instance:
uuid: "93534fe098c646dbb85bd0abb3846760"
format_stamp: "Formatted at 2026-08-06 04:48:21 on dist-test-slave-0b58"
server_key: "eb635432f893a7b857ce5e6bfa89faa2"
server_key_iv: "ab00311efa42d2e159ba6168ada0e5cd"
server_key_version: "encryptionkey@0"
I20260806 04:48:21.443100 21409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/wal/instance:
uuid: "93534fe098c646dbb85bd0abb3846760"
format_stamp: "Formatted at 2026-08-06 04:48:21 on dist-test-slave-0b58"
server_key: "eb635432f893a7b857ce5e6bfa89faa2"
server_key_iv: "ab00311efa42d2e159ba6168ada0e5cd"
server_key_version: "encryptionkey@0"
I20260806 04:48:21.447912 21409 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.006s
I20260806 04:48:21.451113 21424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:21.452392 21409 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 04:48:21.452535 21409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/wal
uuid: "93534fe098c646dbb85bd0abb3846760"
format_stamp: "Formatted at 2026-08-06 04:48:21 on dist-test-slave-0b58"
server_key: "eb635432f893a7b857ce5e6bfa89faa2"
server_key_iv: "ab00311efa42d2e159ba6168ada0e5cd"
server_key_version: "encryptionkey@0"
I20260806 04:48:21.452704 21409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:21.465260 21326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } attempt: 3
I20260806 04:48:21.466287 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.465832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:36094)
0806 04:48:21.466035 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.466116 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 04:48:21.467315 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.466905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:36110)
0806 04:48:21.467113 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.467194 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
W20260806 04:48:21.467571 21326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:45625: Network error: Client connection negotiation failed: client connection to 127.7.113.252:45625: connect: Connection refused (error 111)
I20260806 04:48:21.482832 21409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:21.486936 21409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:21.487217 21409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:21.505146 21409 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.252:45625
I20260806 04:48:21.505204 21475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.252:45625 every 8 connection(s)
I20260806 04:48:21.506458 21409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/data/info.pb
I20260806 04:48:21.509825 21476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:21.515681 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 21409
I20260806 04:48:21.515909 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785991498713577-7623-0/minicluster-data/master-2/wal/instance
I20260806 04:48:21.516489 7623 external_mini_cluster.cc:1428] Setting key c1497e18d2b98d927de47441d0a3d088
I20260806 04:48:21.515978 21476 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:48:21 dist-test-slave-0b58 krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991701, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.252@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
Aug 06 04:48:21 dist-test-slave-0b58 krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.252@KRBTEST.COM
I20260806 04:48:21.537550 21330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.519374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55972 (local address 127.7.113.254:44403)
0806 04:48:21.519577 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:21.519583 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:21.520362 (+ 779us) server_negotiation.cc:407] Connection header received
0806 04:48:21.521961 (+ 1599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:21.521966 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:21.522042 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:21.522140 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:21.523797 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.524895 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.526810 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.527223 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.527368 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.531102 (+ 3734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:21.531109 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:21.531114 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:21.531160 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:21.534355 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.535143 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.535151 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.535154 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.535322 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.535743 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.535749 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.535752 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.536103 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:21.536311 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:21.537107 (+ 796us) server_negotiation.cc:299] Negotiation successful
0806 04:48:21.537295 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 04:48:21.538739 21480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.519321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:44403 (local address 127.0.0.1:55972)
0806 04:48:21.520200 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.520245 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:21.521690 (+ 1445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:21.522224 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:21.522230 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:21.523051 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:21.523614 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.523638 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.525053 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.525057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.526657 (+ 1600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.526680 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.527454 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.527459 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.527642 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.528367 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:21.528403 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:21.530899 (+ 2496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:21.534490 (+ 3591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.534498 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.534506 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.535010 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.535433 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.535439 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.535442 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.535617 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.536223 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:21.536227 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:21.536695 (+ 468us) client_negotiation.cc:769] Sending connection context
0806 04:48:21.536980 (+ 285us) client_negotiation.cc:240] Negotiation successful
0806 04:48:21.537411 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"spinlock_wait_cycles":14592,"thread_start_us":406,"threads_started":1}
I20260806 04:48:21.538915 21479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.518319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36124 (local address 127.7.113.252:45625)
0806 04:48:21.519061 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:21.519071 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:21.519104 (+ 33us) server_negotiation.cc:407] Connection header received
0806 04:48:21.521660 (+ 2556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:21.521687 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:21.521974 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:21.522171 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:21.524069 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.525558 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.527314 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.527944 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.528070 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.532511 (+ 4441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:21.532524 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:21.532541 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:21.532587 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:21.535743 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.536519 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.536526 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.536529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.536672 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.537143 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.537148 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.537151 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.537567 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:21.537855 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:21.538417 (+ 562us) server_negotiation.cc:299] Negotiation successful
0806 04:48:21.538576 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":312,"threads_started":1}
I20260806 04:48:21.541260 21476 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:48:21 dist-test-slave-0b58 krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991701, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.252@KRBTEST.COM for kudu/127.7.113.253@KRBTEST.COM
Aug 06 04:48:21 dist-test-slave-0b58 krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:21.554745 21480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.541978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:42983 (local address 127.0.0.1:33086)
0806 04:48:21.542194 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.542210 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:21.542295 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:21.542597 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:21.542602 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:21.543034 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:21.543233 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.543248 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.544389 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.544392 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.545547 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.545562 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.546239 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.546247 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.546457 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.547023 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:21.547044 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:21.549372 (+ 2328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:21.552493 (+ 3121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.552499 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.552503 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.552866 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.553261 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.553265 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.553269 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.553404 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.553858 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:21.553863 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:21.554007 (+ 144us) client_negotiation.cc:769] Sending connection context
0806 04:48:21.554141 (+ 134us) client_negotiation.cc:240] Negotiation successful
0806 04:48:21.554395 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260806 04:48:21.554780 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.542153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33086 (local address 127.7.113.253:42983)
0806 04:48:21.542309 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:21.542315 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:21.542334 (+ 19us) server_negotiation.cc:407] Connection header received
0806 04:48:21.542388 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:21.542393 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:21.542468 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:21.542559 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:21.543406 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.544194 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.545690 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.546097 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.546200 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.549553 (+ 3353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:21.549558 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:21.549561 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:21.549593 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:21.552352 (+ 2759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.552985 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.552991 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.552994 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.553140 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.553508 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.553514 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.553517 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.553747 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:21.553900 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:21.554227 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 04:48:21.554422 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 04:48:21.555796 21476 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } has no permanent_uuid. Determining permanent_uuid...
I20260806 04:48:21.556838 21330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.541933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55974 (local address 127.7.113.254:44403)
0806 04:48:21.542080 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:21.542085 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:21.542156 (+ 71us) server_negotiation.cc:407] Connection header received
0806 04:48:21.542311 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:21.542316 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:21.542386 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:21.542482 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:21.543910 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.544783 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.546351 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.546848 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.546966 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.551222 (+ 4256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:21.551227 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:21.551230 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:21.551257 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:21.553787 (+ 2530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.554411 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.554417 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.554421 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.554540 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.554957 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.554964 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.554968 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.555289 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:21.555555 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:21.556140 (+ 585us) server_negotiation.cc:299] Negotiation successful
0806 04:48:21.556489 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Aug 06 04:48:21 dist-test-slave-0b58 krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991701, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.252@KRBTEST.COM for kudu/127.7.113.252@KRBTEST.COM
Aug 06 04:48:21 dist-test-slave-0b58 krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.253@KRBTEST.COM
I20260806 04:48:21.570212 21480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.556702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:36128)
0806 04:48:21.556875 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.556908 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:21.557005 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:21.557761 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:21.557766 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:21.558149 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:21.558320 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.558331 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.559243 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.559249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.560679 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.560691 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.561557 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.561561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.561751 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.562265 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:21.562289 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:21.564842 (+ 2553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:21.567753 (+ 2911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.567758 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.567762 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.568174 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.568554 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.568560 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.568563 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.568684 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.569239 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:21.569244 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:21.569393 (+ 149us) client_negotiation.cc:769] Sending connection context
0806 04:48:21.569538 (+ 145us) client_negotiation.cc:240] Negotiation successful
0806 04:48:21.569826 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 04:48:21.570269 21479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.557332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36128 (local address 127.7.113.252:45625)
0806 04:48:21.557495 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:21.557499 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:21.557512 (+ 13us) server_negotiation.cc:407] Connection header received
0806 04:48:21.557546 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:21.557549 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:21.557594 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:21.557704 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:21.558479 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.559124 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.560804 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.561426 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.561539 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.565025 (+ 3486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:21.565031 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:21.565037 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:21.565070 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:21.567604 (+ 2534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.568314 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.568319 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.568322 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.568439 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.568810 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.568815 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.568818 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.569130 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:21.569273 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:21.569626 (+ 353us) server_negotiation.cc:299] Negotiation successful
0806 04:48:21.569976 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":137,"server-negotiator.queue_time_us":70}
I20260806 04:48:21.574293 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.558406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33092 (local address 127.7.113.253:42983)
0806 04:48:21.558558 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:21.558564 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:21.558635 (+ 71us) server_negotiation.cc:407] Connection header received
0806 04:48:21.558805 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:21.558810 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:21.558873 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:21.558971 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:21.560589 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.561594 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.563501 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.564187 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.564340 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.568821 (+ 4481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:21.568831 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:21.568834 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:21.568868 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:21.571766 (+ 2898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.572462 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.572467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.572470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.572606 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.572971 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.572976 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.572979 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.573217 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:21.573481 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:21.573750 (+ 269us) server_negotiation.cc:299] Negotiation successful
0806 04:48:21.573979 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 04:48:21.575364 21476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760: Bootstrap starting.
I20260806 04:48:21.579056 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:48:21.579319 21476 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:21.580381 21476 log.cc:824] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:21.582974 21476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760: No bootstrap required, opened a new log
I20260806 04:48:21.593866 21476 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } }
I20260806 04:48:21.594460 21476 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:21.594661 21476 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93534fe098c646dbb85bd0abb3846760, State: Initialized, Role: FOLLOWER
I20260806 04:48:21.595485 21476 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } }
I20260806 04:48:21.602527 21489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } } }
I20260806 04:48:21.602983 21489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:48:21.604194 21330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.584215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55984 (local address 127.7.113.254:44403)
0806 04:48:21.584410 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:21.584418 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:21.585065 (+ 647us) server_negotiation.cc:407] Connection header received
0806 04:48:21.585305 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:21.585311 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:21.585386 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:21.585456 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:21.587765 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.588915 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.591284 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.591945 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.592043 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.595977 (+ 3934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:21.595986 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:21.595994 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:21.596052 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:21.600544 (+ 4492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.601715 (+ 1171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.601724 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.601730 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.601939 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.602488 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.602494 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.602499 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.602874 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:21.603115 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:21.603613 (+ 498us) server_negotiation.cc:299] Negotiation successful
0806 04:48:21.603849 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 04:48:21.604579 21476 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:48:21.618202 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.584463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33096 (local address 127.7.113.253:42983)
0806 04:48:21.591480 (+ 7017us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:21.591488 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:21.595216 (+ 3728us) server_negotiation.cc:407] Connection header received
0806 04:48:21.595779 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:21.595784 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:21.595879 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:21.595963 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:21.598304 (+ 2341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.599719 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.603751 (+ 4032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.604449 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.604559 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.609500 (+ 4941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:21.609509 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:21.609516 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:21.609562 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:21.613612 (+ 4050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.614715 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.614724 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.614730 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.614918 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.615457 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.615465 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.615471 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.615923 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:21.616222 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:21.617430 (+ 1208us) server_negotiation.cc:299] Negotiation successful
0806 04:48:21.617722 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6868}
I20260806 04:48:21.620612 21479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.585668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36134 (local address 127.7.113.252:45625)
0806 04:48:21.588319 (+ 2651us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:21.588331 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:21.602942 (+ 14611us) server_negotiation.cc:407] Connection header received
0806 04:48:21.603190 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:21.603195 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:21.603262 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:21.603339 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:21.605092 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.606322 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.608772 (+ 2450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.609780 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.609907 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.612725 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:21.612731 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:21.612736 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:21.612780 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:21.616747 (+ 3967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.617593 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.617598 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.617602 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.617806 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.618249 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.618254 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.618257 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.618617 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:21.618866 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:21.619982 (+ 1116us) server_negotiation.cc:299] Negotiation successful
0806 04:48:21.620195 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2429}
W20260806 04:48:21.621385 21500 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 04:48:21.621572 21500 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 04:48:21.614626 21409 master_runner.cc:186] Error getting master registration for 127.7.113.254:44403: OK, instance_id { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" instance_seqno: 1785991700507067 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 04:48:21.627439 21409 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 04:48:21.644784 21326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } attempt: 4
Aug 06 04:48:21 dist-test-slave-0b58 krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991700, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for kudu/127.7.113.252@KRBTEST.COM
I20260806 04:48:21.659816 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.645310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:36144)
0806 04:48:21.645491 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.645509 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:21.645622 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:21.645948 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:21.645952 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:21.646369 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:21.646525 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.646533 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.647608 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.647614 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.648588 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.648600 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.649333 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.649338 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.649527 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.650970 (+ 1443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:21.650994 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:21.653477 (+ 2483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:21.656888 (+ 3411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.656896 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.656902 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.657552 (+ 650us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.657937 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.657944 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.657951 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.658127 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.658800 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:21.658806 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:21.658993 (+ 187us) client_negotiation.cc:769] Sending connection context
0806 04:48:21.659146 (+ 153us) client_negotiation.cc:240] Negotiation successful
0806 04:48:21.659431 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 04:48:21.660764 21479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.645388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36144 (local address 127.7.113.252:45625)
0806 04:48:21.645542 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:21.645552 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:21.645570 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:48:21.645742 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:21.645748 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:21.645819 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:21.645915 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:21.646664 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.647472 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.648742 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.649165 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.649319 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.653645 (+ 4326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:21.653650 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:21.653653 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:21.653681 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:21.656718 (+ 3037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.657674 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.657678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.657680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.657818 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.658273 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.658278 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.658280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.658650 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:21.658817 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:21.660105 (+ 1288us) server_negotiation.cc:299] Negotiation successful
0806 04:48:21.660365 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 04:48:21.665062 21326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8: Bootstrap starting.
I20260806 04:48:21.668411 21326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:21.669433 21326 log.cc:824] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:21.672170 21326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8: No bootstrap required, opened a new log
I20260806 04:48:21.680145 21326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } }
I20260806 04:48:21.680553 21326 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:21.680685 21326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82b96813c4a14f1991105c8c7c5812a8, State: Initialized, Role: FOLLOWER
I20260806 04:48:21.681219 21326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } }
I20260806 04:48:21.682200 21503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } } }
I20260806 04:48:21.682610 21503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:48:21.683351 21326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 04:48:21.693827 21514 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 04:48:21.694015 21514 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 04:48:21.693265 21258 master_runner.cc:186] Error getting master registration for 127.7.113.253:42983: OK, instance_id { permanent_uuid: "ad102e14959447b488533bcc6a04e010" instance_seqno: 1785991700995666 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 04:48:21.705895 21258 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 04:48:21.714783 21402 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } attempt: 5
Aug 06 04:48:21 dist-test-slave-0b58 krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991700, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.253@KRBTEST.COM for kudu/127.7.113.252@KRBTEST.COM
I20260806 04:48:21.732106 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.715330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:45625 (local address 127.0.0.1:36150)
0806 04:48:21.715697 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:21.715716 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:21.715818 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:21.716322 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:21.716327 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:21.716879 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:21.717091 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.717103 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.718583 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.718589 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.720004 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:21.720019 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.721069 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.721075 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:21.721301 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.722025 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:21.722050 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:21.724961 (+ 2911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:21.729172 (+ 4211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.729177 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.729182 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.729705 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.730137 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:21.730143 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:21.730147 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:21.730323 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:21.731071 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:21.731077 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:21.731234 (+ 157us) client_negotiation.cc:769] Sending connection context
0806 04:48:21.731410 (+ 176us) client_negotiation.cc:240] Negotiation successful
0806 04:48:21.731712 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250}
I20260806 04:48:21.733353 21479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:21.715801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36150 (local address 127.7.113.252:45625)
0806 04:48:21.715978 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:21.715984 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:21.716001 (+ 17us) server_negotiation.cc:407] Connection header received
0806 04:48:21.716053 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:21.716058 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:21.716130 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:21.716227 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:21.717251 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.718420 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.720161 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:21.720886 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:21.721037 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:21.725197 (+ 4160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:21.725204 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:21.725209 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:21.725250 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:21.729038 (+ 3788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.729834 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.729840 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.729844 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.729987 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:21.730466 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:21.730478 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:21.730482 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:21.730852 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:21.731005 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:21.732633 (+ 1628us) server_negotiation.cc:299] Negotiation successful
0806 04:48:21.732892 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260806 04:48:21.739159 21430 tablet.cc:2369] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:48:21.739506 21402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010: Bootstrap starting.
I20260806 04:48:21.743480 21402 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:21.744819 21402 log.cc:824] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010: Log is configured to *not* fsync() on all Append() calls
W20260806 04:48:21.746480 21280 tablet.cc:2369] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:48:21.749593 21402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010: No bootstrap required, opened a new log
I20260806 04:48:21.761090 21402 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } }
I20260806 04:48:21.761569 21402 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:21.761691 21402 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad102e14959447b488533bcc6a04e010, State: Initialized, Role: FOLLOWER
I20260806 04:48:21.762382 21402 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } }
I20260806 04:48:21.763367 21517 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } } }
I20260806 04:48:21.763859 21517 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:48:21.764716 21402 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:48:21.784337 21333 master_runner.cc:263] No leader master found from master ad102e14959447b488533bcc6a04e010
I20260806 04:48:21.784488 21333 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 04:48:21.795055 21528 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260806 04:48:21.795053 21489 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260806 04:48:21.795320 21528 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 04:48:21.795336 21489 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } }
I20260806 04:48:21.796694 21489 leader_election.cc:288] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82b96813c4a14f1991105c8c7c5812a8 (127.7.113.254:44403), ad102e14959447b488533bcc6a04e010 (127.7.113.253:42983)
I20260806 04:48:21.798022 21301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "93534fe098c646dbb85bd0abb3846760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b96813c4a14f1991105c8c7c5812a8" is_pre_election: true
I20260806 04:48:21.798635 21301 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93534fe098c646dbb85bd0abb3846760 in term 0.
I20260806 04:48:21.799237 21376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "93534fe098c646dbb85bd0abb3846760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad102e14959447b488533bcc6a04e010" is_pre_election: true
I20260806 04:48:21.800211 21425 leader_election.cc:302] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b96813c4a14f1991105c8c7c5812a8, 93534fe098c646dbb85bd0abb3846760; no voters:
I20260806 04:48:21.800660 21489 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:48:21.800797 21489 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:48:21.800905 21489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:21.799798 21376 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93534fe098c646dbb85bd0abb3846760 in term 0.
I20260806 04:48:21.804227 21489 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } }
I20260806 04:48:21.806015 21301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "93534fe098c646dbb85bd0abb3846760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82b96813c4a14f1991105c8c7c5812a8"
I20260806 04:48:21.806264 21301 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:21.809645 21301 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93534fe098c646dbb85bd0abb3846760 in term 1.
I20260806 04:48:21.810031 21425 leader_election.cc:302] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82b96813c4a14f1991105c8c7c5812a8, 93534fe098c646dbb85bd0abb3846760; no voters:
I20260806 04:48:21.813966 21376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "93534fe098c646dbb85bd0abb3846760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad102e14959447b488533bcc6a04e010"
I20260806 04:48:21.814181 21376 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:21.815727 21530 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:48:21.817639 21376 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93534fe098c646dbb85bd0abb3846760 in term 1.
I20260806 04:48:21.818207 21489 leader_election.cc:288] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [CANDIDATE]: Term 1 election: Requested vote from peers 82b96813c4a14f1991105c8c7c5812a8 (127.7.113.254:44403), ad102e14959447b488533bcc6a04e010 (127.7.113.253:42983)
I20260806 04:48:21.823411 21530 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [term 1 LEADER]: Becoming Leader. State: Replica: 93534fe098c646dbb85bd0abb3846760, State: Running, Role: LEADER
I20260806 04:48:21.824005 21530 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } }
I20260806 04:48:21.837436 21489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93534fe098c646dbb85bd0abb3846760. Latest consensus state: current_term: 1 leader_uuid: "93534fe098c646dbb85bd0abb3846760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } } }
I20260806 04:48:21.837749 21489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:21.848831 21533 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:48:21.851083 21533 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:48:21.866485 21376 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [term 1 FOLLOWER]: Refusing update from remote peer 93534fe098c646dbb85bd0abb3846760: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:48:21.867478 21489 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:48:21.875205 21301 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [term 1 FOLLOWER]: Refusing update from remote peer 93534fe098c646dbb85bd0abb3846760: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:48:21.876026 21489 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:48:21.913295 21517 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93534fe098c646dbb85bd0abb3846760. Latest consensus state: current_term: 1 leader_uuid: "93534fe098c646dbb85bd0abb3846760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } } }
I20260806 04:48:21.913610 21517 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:48:21.917979 21534 mvcc.cc:205] Tried to move back new op lower bound from 7315422010832965632 to 7315422010677002240. Current Snapshot: MvccSnapshot[applied={T|T < 7315422010832965632}]
I20260806 04:48:21.918978 21517 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "93534fe098c646dbb85bd0abb3846760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } } }
I20260806 04:48:21.919180 21517 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:48:21.920063 21503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93534fe098c646dbb85bd0abb3846760. Latest consensus state: current_term: 1 leader_uuid: "93534fe098c646dbb85bd0abb3846760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } } }
I20260806 04:48:21.920420 21503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:48:21.932833 21503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "93534fe098c646dbb85bd0abb3846760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } } }
I20260806 04:48:21.933060 21503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:48:21.934324 21489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "93534fe098c646dbb85bd0abb3846760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } } }
I20260806 04:48:21.934571 21489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:21.934921 21489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "93534fe098c646dbb85bd0abb3846760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82b96813c4a14f1991105c8c7c5812a8" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 44403 } } peers { permanent_uuid: "ad102e14959447b488533bcc6a04e010" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 42983 } } peers { permanent_uuid: "93534fe098c646dbb85bd0abb3846760" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 45625 } } }
I20260806 04:48:21.935112 21533 catalog_manager.cc:1347] Generated new cluster ID: 55b2f7ad4f5c4217873fcc55b9625402
I20260806 04:48:21.935222 21533 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:48:21.935142 21489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:21.963308 21533 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:48:21.965226 21533 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:48:21.981469 21533 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93534fe098c646dbb85bd0abb3846760: Generated new TSK 0
I20260806 04:48:21.982476 21533 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:48:22.696445 21514 catalog_manager.cc:1259] Loaded cluster ID: 55b2f7ad4f5c4217873fcc55b9625402
I20260806 04:48:22.696542 21514 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8: loading cluster ID for follower catalog manager: success
I20260806 04:48:22.698918 21514 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8: acquiring CA information for follower catalog manager: success
I20260806 04:48:22.700709 21514 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 82b96813c4a14f1991105c8c7c5812a8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 04:48:22.797395 21528 catalog_manager.cc:1259] Loaded cluster ID: 55b2f7ad4f5c4217873fcc55b9625402
I20260806 04:48:22.797531 21528 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010: loading cluster ID for follower catalog manager: success
I20260806 04:48:22.799952 21528 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010: acquiring CA information for follower catalog manager: success
I20260806 04:48:22.801687 21528 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ad102e14959447b488533bcc6a04e010: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 04:48:23.132208 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 21258
I20260806 04:48:23.133561 21321 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:23.245359 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 21258
I20260806 04:48:23.269421 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 21333
I20260806 04:48:23.270526 21396 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:23.375237 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 21333
I20260806 04:48:23.397223 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 21409
I20260806 04:48:23.398267 21471 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:23.505671 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 21409
2026-08-06T04:48:23Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4804 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:48:23 dist-test-slave-0b58 krb5kdc[21554](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:48:23 dist-test-slave-0b58 krb5kdc[21554](info): set up 2 sockets
Aug 06 04:48:23 dist-test-slave-0b58 krb5kdc[21554](info): commencing operation
krb5kdc: starting...
W20260806 04:48:24.618945 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.004s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:48:24 dist-test-slave-0b58 krb5kdc[21554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:48:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:48:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:48:24.879479 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:43723
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:44945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:43723
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:25.208038 21569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:25.208393 21569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:25.208561 21569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:25.215474 21569 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:48:25.215608 21569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:25.215726 21569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:25.215829 21569 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:48:25.215914 21569 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:48:25.225497 21569 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:44945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:43723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:43723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:25.226851 21569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:25.228149 21569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:25.239764 21574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:25.239755 21575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:25.239820 21577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:25.240527 21569 server_base.cc:1034] running on GCE node
I20260806 04:48:25.241336 21569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:25.242679 21569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:25.243933 21569 hybrid_clock.cc:648] HybridClock initialized: now 1785991705243854 us; error 43 us; skew 500 ppm
I20260806 04:48:25.244346 21569 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:25 dist-test-slave-0b58 krb5kdc[21554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991705, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:25.251123 21569 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:48:25.252594 21569 webserver.cc:460] Webserver started at http://127.7.113.254:42895/ using document root <none> and password file <none>
I20260806 04:48:25.253255 21569 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:25.253407 21569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:25.253789 21569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:48:25.256693 21569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "03b19db74d82487dbb1a1926860ba673"
format_stamp: "Formatted at 2026-08-06 04:48:25 on dist-test-slave-0b58"
server_key: "5f7f6a073bfb52c7ce2e714d9c82e9f2"
server_key_iv: "6556249af4d9e712b695323483604c90"
server_key_version: "encryptionkey@0"
I20260806 04:48:25.257426 21569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "03b19db74d82487dbb1a1926860ba673"
format_stamp: "Formatted at 2026-08-06 04:48:25 on dist-test-slave-0b58"
server_key: "5f7f6a073bfb52c7ce2e714d9c82e9f2"
server_key_iv: "6556249af4d9e712b695323483604c90"
server_key_version: "encryptionkey@0"
I20260806 04:48:25.262357 21569 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:48:25.265502 21585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:25.266754 21569 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:48:25.266937 21569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "03b19db74d82487dbb1a1926860ba673"
format_stamp: "Formatted at 2026-08-06 04:48:25 on dist-test-slave-0b58"
server_key: "5f7f6a073bfb52c7ce2e714d9c82e9f2"
server_key_iv: "6556249af4d9e712b695323483604c90"
server_key_version: "encryptionkey@0"
I20260806 04:48:25.267127 21569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:25.284440 21569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:25.288724 21569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:25.289012 21569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:25.307251 21569 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:43723
I20260806 04:48:25.307274 21636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:43723 every 8 connection(s)
I20260806 04:48:25.308588 21569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:48:25.312000 21637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:25.314061 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 21569
I20260806 04:48:25.314265 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:48:25.315094 7623 external_mini_cluster.cc:1428] Setting key 7555402d11d178ede4045b67b6a8c3d8
I20260806 04:48:25.323231 21637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673: Bootstrap starting.
I20260806 04:48:25.326251 21637 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:25.327175 21637 log.cc:824] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673: Log is configured to *not* fsync() on all Append() calls
Aug 06 04:48:25 dist-test-slave-0b58 krb5kdc[21554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:25.330238 21637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673: No bootstrap required, opened a new log
I20260806 04:48:25.336939 21640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:25.317095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44266 (local address 127.7.113.254:43723)
0806 04:48:25.317800 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:25.317811 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:25.317847 (+ 36us) server_negotiation.cc:407] Connection header received
0806 04:48:25.319469 (+ 1622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:25.319489 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:25.319843 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:25.320176 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:25.321653 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:25.322839 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:25.324176 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:25.325025 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:25.325251 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:25.329820 (+ 4569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:25.329827 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:25.329839 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:25.329876 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:25.333024 (+ 3148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:25.333798 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:25.333804 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:25.333810 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:25.333967 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:25.334394 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:25.334397 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:25.334399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:25.334897 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:25.335118 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:25.335582 (+ 464us) server_negotiation.cc:299] Negotiation successful
0806 04:48:25.335904 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":316,"threads_started":1}
I20260806 04:48:25.338913 21637 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03b19db74d82487dbb1a1926860ba673" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43723 } }
I20260806 04:48:25.339296 21637 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:25.339421 21637 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03b19db74d82487dbb1a1926860ba673, State: Initialized, Role: FOLLOWER
I20260806 04:48:25.340035 21637 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03b19db74d82487dbb1a1926860ba673" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43723 } }
I20260806 04:48:25.340273 21637 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:48:25.340445 21637 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:48:25.340636 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:48:25.340641 21637 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:25.343621 21637 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03b19db74d82487dbb1a1926860ba673" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43723 } }
I20260806 04:48:25.344148 21637 leader_election.cc:302] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03b19db74d82487dbb1a1926860ba673; no voters:
I20260806 04:48:25.344848 21637 leader_election.cc:288] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:48:25.344938 21642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:48:25.345696 21642 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [term 1 LEADER]: Becoming Leader. State: Replica: 03b19db74d82487dbb1a1926860ba673, State: Running, Role: LEADER
I20260806 04:48:25.346256 21642 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03b19db74d82487dbb1a1926860ba673" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43723 } }
I20260806 04:48:25.346897 21637 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:48:25.349146 21643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03b19db74d82487dbb1a1926860ba673" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03b19db74d82487dbb1a1926860ba673" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43723 } } }
I20260806 04:48:25.349201 21644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03b19db74d82487dbb1a1926860ba673. Latest consensus state: current_term: 1 leader_uuid: "03b19db74d82487dbb1a1926860ba673" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03b19db74d82487dbb1a1926860ba673" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43723 } } }
I20260806 04:48:25.349577 21643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:25.349649 21644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:25.352099 21648 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:48:25.356891 21648 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:48:25.365000 21648 catalog_manager.cc:1347] Generated new cluster ID: 45aa6d8a64904be2a9b89a2b17bea2c8
I20260806 04:48:25.365090 21648 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:48:25.377630 21648 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:48:25.378822 21648 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:48:25.386775 21648 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03b19db74d82487dbb1a1926860ba673: Generated new TSK 0
I20260806 04:48:25.387627 21648 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:48:25.402187 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 21569
I20260806 04:48:25.403334 21632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:25.493681 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 21569
2026-08-06T04:48:25Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1983 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:48:25 dist-test-slave-0b58 krb5kdc[21667](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:48:25 dist-test-slave-0b58 krb5kdc[21667](info): set up 2 sockets
Aug 06 04:48:25 dist-test-slave-0b58 krb5kdc[21667](info): commencing operation
krb5kdc: starting...
W20260806 04:48:26.606740 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.005s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:48:26 dist-test-slave-0b58 krb5kdc[21667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:48:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:48:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:48:26.865391 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:38423
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:38423
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:27.191620 21681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:27.191943 21681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:27.192097 21681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:27.199187 21681 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:48:27.199343 21681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:27.199440 21681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:27.199542 21681 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:48:27.199625 21681 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:48:27.209247 21681 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:38423
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:38423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:27.210516 21681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:27.211789 21681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:27.223491 21689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:27.223531 21687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:27.223570 21686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:27.224249 21681 server_base.cc:1034] running on GCE node
I20260806 04:48:27.225044 21681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:27.226423 21681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:27.227648 21681 hybrid_clock.cc:648] HybridClock initialized: now 1785991707227607 us; error 49 us; skew 500 ppm
I20260806 04:48:27.228008 21681 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:27 dist-test-slave-0b58 krb5kdc[21667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991707, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:27.231127 21681 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:48:27.232602 21681 webserver.cc:460] Webserver started at http://127.7.113.254:44321/ using document root <none> and password file <none>
I20260806 04:48:27.233253 21681 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:27.233402 21681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:27.233702 21681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:48:27.236683 21681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "547a882df57f4b118b75e5da3a11e9e0"
format_stamp: "Formatted at 2026-08-06 04:48:27 on dist-test-slave-0b58"
server_key: "134ec814ee3c98ef9032da6934b0a928"
server_key_iv: "47d09e0bea721e074e82a62ee6080790"
server_key_version: "encryptionkey@0"
I20260806 04:48:27.237448 21681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "547a882df57f4b118b75e5da3a11e9e0"
format_stamp: "Formatted at 2026-08-06 04:48:27 on dist-test-slave-0b58"
server_key: "134ec814ee3c98ef9032da6934b0a928"
server_key_iv: "47d09e0bea721e074e82a62ee6080790"
server_key_version: "encryptionkey@0"
I20260806 04:48:27.242425 21681 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:48:27.245682 21696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:27.246975 21681 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 04:48:27.247152 21681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "547a882df57f4b118b75e5da3a11e9e0"
format_stamp: "Formatted at 2026-08-06 04:48:27 on dist-test-slave-0b58"
server_key: "134ec814ee3c98ef9032da6934b0a928"
server_key_iv: "47d09e0bea721e074e82a62ee6080790"
server_key_version: "encryptionkey@0"
I20260806 04:48:27.247341 21681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:27.262843 21681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:27.266595 21681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:27.266886 21681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:27.285416 21681 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:38423
I20260806 04:48:27.285459 21747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:38423 every 8 connection(s)
I20260806 04:48:27.286842 21681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:48:27.290256 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 21681
I20260806 04:48:27.290468 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:48:27.290591 21748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:27.291182 7623 external_mini_cluster.cc:1428] Setting key 3964e23ec416b2c5ba18f0431e9a8302
I20260806 04:48:27.305104 21748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Bootstrap starting.
Aug 06 04:48:27 dist-test-slave-0b58 krb5kdc[21667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:27.308888 21748 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:27.310292 21748 log.cc:824] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:27.313673 21748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: No bootstrap required, opened a new log
I20260806 04:48:27.315476 21751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:27.293219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54014 (local address 127.7.113.254:38423)
0806 04:48:27.294106 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:27.294120 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:27.294168 (+ 48us) server_negotiation.cc:407] Connection header received
0806 04:48:27.295849 (+ 1681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:27.295881 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:27.296416 (+ 535us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:27.296862 (+ 446us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:27.298116 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:27.300141 (+ 2025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:27.301524 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:27.302613 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:27.302804 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:27.307133 (+ 4329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:27.307146 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:27.307164 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:27.307213 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:27.311186 (+ 3973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:27.311992 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:27.311999 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:27.312007 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:27.312206 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:27.312704 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:27.312712 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:27.312717 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:27.313426 (+ 709us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:27.313749 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:27.314140 (+ 391us) server_negotiation.cc:299] Negotiation successful
0806 04:48:27.314539 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":346,"threads_started":1}
I20260806 04:48:27.321434 21748 raft_consensus.cc:348] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } }
I20260806 04:48:27.321944 21748 raft_consensus.cc:374] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:27.322077 21748 raft_consensus.cc:729] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 547a882df57f4b118b75e5da3a11e9e0, State: Initialized, Role: FOLLOWER
I20260806 04:48:27.322701 21748 consensus_queue.cc:260] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } }
I20260806 04:48:27.322963 21748 raft_consensus.cc:388] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:48:27.323107 21748 raft_consensus.cc:482] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:48:27.323282 21748 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:27.325495 21748 raft_consensus.cc:504] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } }
I20260806 04:48:27.326066 21748 leader_election.cc:302] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 547a882df57f4b118b75e5da3a11e9e0; no voters:
I20260806 04:48:27.326761 21748 leader_election.cc:288] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:48:27.326874 21753 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:48:27.327560 21753 raft_consensus.cc:686] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 1 LEADER]: Becoming Leader. State: Replica: 547a882df57f4b118b75e5da3a11e9e0, State: Running, Role: LEADER
I20260806 04:48:27.328189 21753 consensus_queue.cc:237] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } }
I20260806 04:48:27.329505 21748 sys_catalog.cc:564] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:48:27.330983 21755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "547a882df57f4b118b75e5da3a11e9e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } } }
I20260806 04:48:27.331426 21755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:27.331616 21754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 547a882df57f4b118b75e5da3a11e9e0. Latest consensus state: current_term: 1 leader_uuid: "547a882df57f4b118b75e5da3a11e9e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } } }
I20260806 04:48:27.332296 21754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:27.334489 21758 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:48:27.339447 21758 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:48:27.347647 21758 catalog_manager.cc:1347] Generated new cluster ID: ae16232fc6454b549a96345a7a1ce1f3
I20260806 04:48:27.347755 21758 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:48:27.364503 21758 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:48:27.366201 21758 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:48:27.378885 21758 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Generated new TSK 0
I20260806 04:48:27.379755 21758 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:48:27.439757 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38423
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:27.765967 21774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:27.766256 21774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:27.766420 21774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:27.773869 21774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:27.773973 21774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:27.774139 21774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:48:27.783806 21774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:27.785113 21774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:27.786432 21774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:27.799399 21780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:27.799455 21779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:27.799480 21783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:27.800576 21774 server_base.cc:1034] running on GCE node
I20260806 04:48:27.801173 21774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:27.802090 21774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:27.803323 21774 hybrid_clock.cc:648] HybridClock initialized: now 1785991707803281 us; error 54 us; skew 500 ppm
I20260806 04:48:27.803647 21774 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:27 dist-test-slave-0b58 krb5kdc[21667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991707, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:27.806695 21774 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:48:27.808084 21774 webserver.cc:460] Webserver started at http://127.7.113.193:36355/ using document root <none> and password file <none>
I20260806 04:48:27.808837 21774 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:27.808984 21774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:27.809293 21774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:48:27.812136 21774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "97367e709a464999bb6334ba7518a37c"
format_stamp: "Formatted at 2026-08-06 04:48:27 on dist-test-slave-0b58"
server_key: "bce963b592c513dd21b67843731e0e8d"
server_key_iv: "bddf3c51c3c0e1c4435f457d97742daf"
server_key_version: "encryptionkey@0"
I20260806 04:48:27.812964 21774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "97367e709a464999bb6334ba7518a37c"
format_stamp: "Formatted at 2026-08-06 04:48:27 on dist-test-slave-0b58"
server_key: "bce963b592c513dd21b67843731e0e8d"
server_key_iv: "bddf3c51c3c0e1c4435f457d97742daf"
server_key_version: "encryptionkey@0"
I20260806 04:48:27.818270 21774 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:48:27.821571 21791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:27.822806 21774 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:48:27.822983 21774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "97367e709a464999bb6334ba7518a37c"
format_stamp: "Formatted at 2026-08-06 04:48:27 on dist-test-slave-0b58"
server_key: "bce963b592c513dd21b67843731e0e8d"
server_key_iv: "bddf3c51c3c0e1c4435f457d97742daf"
server_key_version: "encryptionkey@0"
I20260806 04:48:27.823176 21774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:27.854576 21774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:27.858619 21774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:27.858915 21774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:27.859851 21774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:27.861241 21774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:27.861315 21774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:27.861439 21774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:27.861498 21774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:27.894665 21774 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:43845
I20260806 04:48:27.894703 21907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:43845 every 8 connection(s)
I20260806 04:48:27.895937 21774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:48:27.905625 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 21774
I20260806 04:48:27.905879 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:48:27.906740 7623 external_mini_cluster.cc:1428] Setting key 96c3499fb8ef39f70b9c5269593424a7
Aug 06 04:48:27 dist-test-slave-0b58 krb5kdc[21667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991707, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:27.915678 21910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:27.898598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:32771 (local address 127.7.113.254:38423)
0806 04:48:27.899030 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:27.899036 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:27.900044 (+ 1008us) server_negotiation.cc:407] Connection header received
0806 04:48:27.901821 (+ 1777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:27.901825 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:27.901897 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:27.901991 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:27.903340 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:27.904027 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:27.905857 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:27.906315 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:27.906410 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:27.910140 (+ 3730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:27.910145 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:27.910148 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:27.910179 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:27.912748 (+ 2569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:27.913475 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:27.913481 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:27.913484 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:27.913607 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:27.914037 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:27.914042 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:27.914045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:27.914295 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:27.914457 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:27.915104 (+ 647us) server_negotiation.cc:299] Negotiation successful
0806 04:48:27.915319 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":198,"threads_started":1}
I20260806 04:48:27.916657 21911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:27.899227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:32771)
0806 04:48:27.899881 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:27.899926 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:27.901589 (+ 1663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:27.902182 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:27.902189 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:27.902674 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:27.903198 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:27.903214 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:27.904143 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:27.904146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:27.905669 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:27.905685 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:27.906558 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:27.906566 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:27.906868 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:27.907715 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:27.907740 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:27.909929 (+ 2189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:27.912925 (+ 2996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:27.912934 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:27.912947 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:27.913340 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:27.913729 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:27.913733 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:27.913737 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:27.913919 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:27.914430 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:27.914437 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:27.914746 (+ 309us) client_negotiation.cc:769] Sending connection context
0806 04:48:27.915000 (+ 254us) client_negotiation.cc:240] Negotiation successful
0806 04:48:27.915491 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":259,"threads_started":1}
I20260806 04:48:27.918165 21908 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38423
I20260806 04:48:27.918453 21908 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:27.919116 21908 heartbeater.cc:511] Master 127.7.113.254:38423 requested a full tablet report, sending...
I20260806 04:48:27.921166 21713 ts_manager.cc:194] Registered new tserver with Master: 97367e709a464999bb6334ba7518a37c (127.7.113.193:43845)
I20260806 04:48:27.922566 21713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:32771
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:48:27.967094 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38423
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:28.309500 21914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:28.309793 21914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:28.309970 21914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:28.317102 21914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:28.317255 21914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:28.317428 21914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:48:28.327164 21914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:28.328480 21914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:28.329806 21914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:28.342839 21920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:28.342799 21923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:28.342869 21921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:28.345523 21914 server_base.cc:1034] running on GCE node
I20260806 04:48:28.346124 21914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:28.347054 21914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:28.348346 21914 hybrid_clock.cc:648] HybridClock initialized: now 1785991708348305 us; error 54 us; skew 500 ppm
I20260806 04:48:28.348666 21914 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:28 dist-test-slave-0b58 krb5kdc[21667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991708, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:28.351990 21914 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:48:28.353500 21914 webserver.cc:460] Webserver started at http://127.7.113.194:44285/ using document root <none> and password file <none>
I20260806 04:48:28.354195 21914 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:28.354327 21914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:28.354636 21914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:48:28.357508 21914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "ade63e40c1c44d2c8ac92aa00741daf7"
format_stamp: "Formatted at 2026-08-06 04:48:28 on dist-test-slave-0b58"
server_key: "26aa5f807c60c59641d992dff8c5f787"
server_key_iv: "1246258b6619252a8ff664ab3d835ff4"
server_key_version: "encryptionkey@0"
I20260806 04:48:28.358250 21914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "ade63e40c1c44d2c8ac92aa00741daf7"
format_stamp: "Formatted at 2026-08-06 04:48:28 on dist-test-slave-0b58"
server_key: "26aa5f807c60c59641d992dff8c5f787"
server_key_iv: "1246258b6619252a8ff664ab3d835ff4"
server_key_version: "encryptionkey@0"
I20260806 04:48:28.363379 21914 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260806 04:48:28.366623 21931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:28.367830 21914 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 04:48:28.368000 21914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "ade63e40c1c44d2c8ac92aa00741daf7"
format_stamp: "Formatted at 2026-08-06 04:48:28 on dist-test-slave-0b58"
server_key: "26aa5f807c60c59641d992dff8c5f787"
server_key_iv: "1246258b6619252a8ff664ab3d835ff4"
server_key_version: "encryptionkey@0"
I20260806 04:48:28.368189 21914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:28.379498 21914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:28.383138 21914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:28.383419 21914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:28.384344 21914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:28.385591 21914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:28.385680 21914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:28.385849 21914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:28.385901 21914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:28.418093 21914 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:38421
I20260806 04:48:28.418141 22044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:38421 every 8 connection(s)
I20260806 04:48:28.419371 21914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:48:28.424227 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 21914
I20260806 04:48:28.424463 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:48:28.424901 7623 external_mini_cluster.cc:1428] Setting key 0c8075aa564aefbc6bf3b8f5d2efddad
Aug 06 04:48:28 dist-test-slave-0b58 krb5kdc[21667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991708, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:28.439632 22047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:28.422138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:44221 (local address 127.7.113.254:38423)
0806 04:48:28.422627 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:28.422635 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:28.423497 (+ 862us) server_negotiation.cc:407] Connection header received
0806 04:48:28.425418 (+ 1921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:28.425437 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:28.425513 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:28.425601 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:28.427245 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:28.428056 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:28.429642 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:28.430235 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:28.430367 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:28.433910 (+ 3543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:28.433915 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:28.433919 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:28.433949 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:28.436710 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:28.437438 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:28.437442 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:28.437445 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:28.437564 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:28.437989 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:28.437994 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:28.437996 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:28.438244 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:28.438396 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:28.439033 (+ 637us) server_negotiation.cc:299] Negotiation successful
0806 04:48:28.439262 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":227,"threads_started":1}
I20260806 04:48:28.440579 22048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:28.422682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:44221)
0806 04:48:28.423344 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:28.423383 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:28.425162 (+ 1779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:28.425831 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:28.425838 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:28.426404 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:28.427079 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:28.427098 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:28.428204 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:28.428210 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:28.429504 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:28.429515 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:28.430454 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:28.430461 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:28.430777 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:28.431551 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:28.431572 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:28.433684 (+ 2112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:28.436872 (+ 3188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:28.436880 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:28.436894 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:28.437307 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:28.437670 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:28.437675 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:28.437679 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:28.437865 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:28.438367 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:28.438374 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:28.438686 (+ 312us) client_negotiation.cc:769] Sending connection context
0806 04:48:28.438936 (+ 250us) client_negotiation.cc:240] Negotiation successful
0806 04:48:28.439425 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":255,"threads_started":1}
I20260806 04:48:28.441926 22045 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38423
I20260806 04:48:28.442221 22045 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:28.443005 22045 heartbeater.cc:511] Master 127.7.113.254:38423 requested a full tablet report, sending...
I20260806 04:48:28.444548 21713 ts_manager.cc:194] Registered new tserver with Master: ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421)
I20260806 04:48:28.445361 21713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:44221
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:48:28.495659 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38423
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:28.822777 22051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:28.823020 22051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:28.823135 22051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:28.830385 22051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:28.830506 22051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:28.830680 22051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:48:28.840116 22051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:38423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:28.841334 22051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:28.842571 22051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:28.856004 22056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:28.855965 22057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:28.856045 22059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:28.856737 22051 server_base.cc:1034] running on GCE node
I20260806 04:48:28.857328 22051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:28.858162 22051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:28.859354 22051 hybrid_clock.cc:648] HybridClock initialized: now 1785991708859296 us; error 48 us; skew 500 ppm
I20260806 04:48:28.859649 22051 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:28 dist-test-slave-0b58 krb5kdc[21667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991708, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:28.862658 22051 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:48:28.864037 22051 webserver.cc:460] Webserver started at http://127.7.113.195:41687/ using document root <none> and password file <none>
I20260806 04:48:28.864756 22051 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:28.864913 22051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:28.865207 22051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:48:28.867949 22051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "a8c6f2aa11f744f1b5eb399846e690fa"
format_stamp: "Formatted at 2026-08-06 04:48:28 on dist-test-slave-0b58"
server_key: "5c1b7a3f851623b68274fc59c70f6097"
server_key_iv: "e5927006b4d03b161e533e8675d8178c"
server_key_version: "encryptionkey@0"
I20260806 04:48:28.868712 22051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "a8c6f2aa11f744f1b5eb399846e690fa"
format_stamp: "Formatted at 2026-08-06 04:48:28 on dist-test-slave-0b58"
server_key: "5c1b7a3f851623b68274fc59c70f6097"
server_key_iv: "e5927006b4d03b161e533e8675d8178c"
server_key_version: "encryptionkey@0"
I20260806 04:48:28.873795 22051 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:48:28.877170 22066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:28.878417 22051 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:48:28.878592 22051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "a8c6f2aa11f744f1b5eb399846e690fa"
format_stamp: "Formatted at 2026-08-06 04:48:28 on dist-test-slave-0b58"
server_key: "5c1b7a3f851623b68274fc59c70f6097"
server_key_iv: "e5927006b4d03b161e533e8675d8178c"
server_key_version: "encryptionkey@0"
I20260806 04:48:28.878811 22051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:28.893442 22051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:28.897619 22051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:28.897935 22051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:28.898916 22051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:28.900213 22051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:28.900336 22051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260806 04:48:28.900496 22051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:28.900575 22051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:28.925356 21908 heartbeater.cc:503] Master 127.7.113.254:38423 was elected leader, sending a full tablet report...
I20260806 04:48:28.934763 22051 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:43219
I20260806 04:48:28.934844 22179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:43219 every 8 connection(s)
I20260806 04:48:28.936095 22051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:48:28.943524 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 22051
I20260806 04:48:28.943724 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:48:28.944173 7623 external_mini_cluster.cc:1428] Setting key 76315015af3c099ca85ed673ed254abd
Aug 06 04:48:28 dist-test-slave-0b58 krb5kdc[21667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991708, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:28.955607 22047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:28.938580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:54719 (local address 127.7.113.254:38423)
0806 04:48:28.938760 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:28.938764 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:28.939885 (+ 1121us) server_negotiation.cc:407] Connection header received
0806 04:48:28.941956 (+ 2071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:28.941962 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:28.942067 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:28.942177 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:28.943638 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:28.944510 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:28.946441 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:28.946948 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:28.947082 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:28.950394 (+ 3312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:28.950398 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:28.950402 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:28.950432 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:28.953169 (+ 2737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:28.953781 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:28.953784 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:28.953786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:28.953901 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:28.954262 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:28.954265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:28.954267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:28.954556 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:28.954677 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:28.955234 (+ 557us) server_negotiation.cc:299] Negotiation successful
0806 04:48:28.955390 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 04:48:28.956543 22182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:28.939022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:54719)
0806 04:48:28.939720 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:28.939765 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:28.941695 (+ 1930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:28.942408 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:28.942415 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:28.942909 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:28.943463 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:28.943480 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:28.944679 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:28.944683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:28.946302 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:28.946314 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:28.947162 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:28.947169 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:28.947402 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:28.948008 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:28.948028 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:28.950214 (+ 2186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:28.953295 (+ 3081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:28.953300 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:28.953310 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:28.953684 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:28.953988 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:28.953991 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:28.953993 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:28.954172 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:28.954662 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:28.954668 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:28.954938 (+ 270us) client_negotiation.cc:769] Sending connection context
0806 04:48:28.955143 (+ 205us) client_negotiation.cc:240] Negotiation successful
0806 04:48:28.955459 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":269,"threads_started":1}
I20260806 04:48:28.957880 22180 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38423
I20260806 04:48:28.958165 22180 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:28.958822 22180 heartbeater.cc:511] Master 127.7.113.254:38423 requested a full tablet report, sending...
I20260806 04:48:28.960150 21713 ts_manager.cc:194] Registered new tserver with Master: a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219)
I20260806 04:48:28.960971 21713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:54719
I20260806 04:48:28.971127 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:48:28.987627 22047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:28.975803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54024 (local address 127.7.113.254:38423)
0806 04:48:28.975981 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:28.975985 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:28.976478 (+ 493us) server_negotiation.cc:407] Connection header received
0806 04:48:28.976606 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:28.976610 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:28.976673 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:28.976748 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:28.978189 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:28.978865 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:28.980136 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:28.980583 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:28.980673 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:28.982963 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:28.982967 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:28.982970 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:28.982997 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:28.985455 (+ 2458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:28.986031 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:28.986034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:28.986036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:28.986157 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:28.986506 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:28.986509 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:28.986511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:28.986790 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:28.986976 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:28.987216 (+ 240us) server_negotiation.cc:299] Negotiation successful
0806 04:48:28.987357 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 04:48:28.991504 21713 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54024:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:48:28.998456 21713 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:48:29.032269 22196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.011299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48274 (local address 127.7.113.195:43219)
0806 04:48:29.022940 (+ 11641us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:29.022948 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:29.022978 (+ 30us) server_negotiation.cc:407] Connection header received
0806 04:48:29.023071 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:29.023078 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:29.023328 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:29.024309 (+ 981us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:29.024605 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.026284 (+ 1679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.029718 (+ 3434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.031060 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.031157 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.031340 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:29.031731 (+ 391us) server_negotiation.cc:299] Negotiation successful
0806 04:48:29.031918 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11448,"thread_start_us":11581,"threads_started":1}
I20260806 04:48:29.032456 22193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.010968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:43219 (local address 127.0.0.1:48274)
0806 04:48:29.022700 (+ 11732us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:29.022718 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:29.022824 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:29.023576 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:29.023584 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:29.023614 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:29.024062 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:29.024080 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.026466 (+ 2386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.026471 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:29.029569 (+ 3098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:29.029577 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.031274 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.031280 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:29.031481 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.031537 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 04:48:29.031678 (+ 141us) client_negotiation.cc:240] Negotiation successful
0806 04:48:29.031856 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11590,"mutex_wait_us":292,"thread_start_us":10741,"threads_started":1}
I20260806 04:48:29.033210 22197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.013468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43845 (local address 127.0.0.1:52556)
0806 04:48:29.025163 (+ 11695us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:29.025176 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:29.025308 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:29.025811 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:29.025815 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:29.025838 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:29.026415 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:29.026433 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.028132 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.028139 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:29.030005 (+ 1866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:29.030037 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.032404 (+ 2367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.032411 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:29.032609 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.032660 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 04:48:29.032755 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 04:48:29.032895 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11591,"mutex_wait_us":112,"thread_start_us":11447,"threads_started":1}
I20260806 04:48:29.034046 22195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.010780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:38421 (local address 127.0.0.1:49274)
0806 04:48:29.022082 (+ 11302us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:29.022125 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:29.022283 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:29.024316 (+ 2033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:29.024319 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:29.024340 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:29.024747 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:29.024761 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.026615 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.026620 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:29.029540 (+ 2920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:29.029555 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.033297 (+ 3742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.033303 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:29.033497 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.033526 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 04:48:29.033605 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 04:48:29.033725 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11081,"mutex_wait_us":225,"thread_start_us":11630,"threads_started":1}
I20260806 04:48:29.034076 22198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.014234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52556 (local address 127.7.113.193:43845)
0806 04:48:29.024694 (+ 10460us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:29.024705 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:29.025281 (+ 576us) server_negotiation.cc:407] Connection header received
0806 04:48:29.025477 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:29.025483 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:29.025640 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:29.025818 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:29.026626 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.027963 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.030417 (+ 2454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.031832 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.031988 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.032207 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:29.033517 (+ 1310us) server_negotiation.cc:299] Negotiation successful
0806 04:48:29.033705 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10277,"thread_start_us":10114,"threads_started":1}
I20260806 04:48:29.034842 22194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.010926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49274 (local address 127.7.113.194:38421)
0806 04:48:29.023468 (+ 12542us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:29.023479 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:29.023507 (+ 28us) server_negotiation.cc:407] Connection header received
0806 04:48:29.023593 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:29.023600 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:29.023822 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:29.024020 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:29.024997 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.026458 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.031421 (+ 4963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.032796 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.032933 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.033116 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:29.034512 (+ 1396us) server_negotiation.cc:299] Negotiation successful
0806 04:48:29.034636 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12380,"thread_start_us":12284,"threads_started":1}
I20260806 04:48:29.036871 22114 tablet_service.cc:1467] Processing CreateTablet for tablet e29a4c74d9c84959b4e87626a01cbd83 (DEFAULT_TABLE table=test-table [id=9bf1501ea29c4f0c9f109434885c4dd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:48:29.037305 21841 tablet_service.cc:1467] Processing CreateTablet for tablet e29a4c74d9c84959b4e87626a01cbd83 (DEFAULT_TABLE table=test-table [id=9bf1501ea29c4f0c9f109434885c4dd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:48:29.038548 21841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29a4c74d9c84959b4e87626a01cbd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:29.038549 22114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29a4c74d9c84959b4e87626a01cbd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:29.038395 21980 tablet_service.cc:1467] Processing CreateTablet for tablet e29a4c74d9c84959b4e87626a01cbd83 (DEFAULT_TABLE table=test-table [id=9bf1501ea29c4f0c9f109434885c4dd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:48:29.039700 21980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29a4c74d9c84959b4e87626a01cbd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:29.049484 22199 tablet_bootstrap.cc:492] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c: Bootstrap starting.
I20260806 04:48:29.052946 22200 tablet_bootstrap.cc:492] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa: Bootstrap starting.
I20260806 04:48:29.053903 22199 tablet_bootstrap.cc:654] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:29.055296 22199 log.cc:824] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:29.056438 22200 tablet_bootstrap.cc:654] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:29.057680 22200 log.cc:824] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:29.058476 22199 tablet_bootstrap.cc:492] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c: No bootstrap required, opened a new log
I20260806 04:48:29.058717 22199 ts_tablet_manager.cc:1397] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.004s
I20260806 04:48:29.060360 22201 tablet_bootstrap.cc:492] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7: Bootstrap starting.
I20260806 04:48:29.060611 22200 tablet_bootstrap.cc:492] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa: No bootstrap required, opened a new log
I20260806 04:48:29.060858 22200 ts_tablet_manager.cc:1397] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260806 04:48:29.063309 22201 tablet_bootstrap.cc:654] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:29.064235 22201 log.cc:824] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:29.066668 22201 tablet_bootstrap.cc:492] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7: No bootstrap required, opened a new log
I20260806 04:48:29.066922 22201 ts_tablet_manager.cc:1397] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.002s
I20260806 04:48:29.069386 22199 raft_consensus.cc:348] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } }
I20260806 04:48:29.069808 22199 raft_consensus.cc:374] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:29.069912 22199 raft_consensus.cc:729] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97367e709a464999bb6334ba7518a37c, State: Initialized, Role: FOLLOWER
I20260806 04:48:29.070552 22199 consensus_queue.cc:260] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } }
I20260806 04:48:29.071462 22200 raft_consensus.cc:348] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } }
I20260806 04:48:29.071861 22200 raft_consensus.cc:374] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:29.071973 22200 raft_consensus.cc:729] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c6f2aa11f744f1b5eb399846e690fa, State: Initialized, Role: FOLLOWER
I20260806 04:48:29.073535 22199 ts_tablet_manager.cc:1428] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c: Time spent starting tablet: real 0.015s user 0.009s sys 0.006s
I20260806 04:48:29.073845 22200 consensus_queue.cc:260] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } }
I20260806 04:48:29.074990 22180 heartbeater.cc:503] Master 127.7.113.254:38423 was elected leader, sending a full tablet report...
I20260806 04:48:29.075608 22200 ts_tablet_manager.cc:1428] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260806 04:48:29.075413 22201 raft_consensus.cc:348] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } }
I20260806 04:48:29.075811 22201 raft_consensus.cc:374] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:29.075894 22201 raft_consensus.cc:729] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade63e40c1c44d2c8ac92aa00741daf7, State: Initialized, Role: FOLLOWER
I20260806 04:48:29.076457 22201 consensus_queue.cc:260] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } }
I20260806 04:48:29.077561 22045 heartbeater.cc:503] Master 127.7.113.254:38423 was elected leader, sending a full tablet report...
I20260806 04:48:29.078240 22201 ts_tablet_manager.cc:1428] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260806 04:48:29.129462 22206 raft_consensus.cc:482] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:48:29.129935 22206 raft_consensus.cc:504] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } }
I20260806 04:48:29.132040 22206 leader_election.cc:288] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421), 97367e709a464999bb6334ba7518a37c (127.7.113.193:43845)
I20260806 04:48:29.137938 22182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.132224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:38421 (local address 127.7.113.195:55663)
0806 04:48:29.132548 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:29.132571 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:29.132708 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:29.133153 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:29.133159 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:29.133196 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:29.133521 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:29.133540 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.134670 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.134675 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:29.136357 (+ 1682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:29.136375 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.137375 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.137380 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:29.137563 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.137587 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 04:48:29.137665 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 04:48:29.137752 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180}
I20260806 04:48:29.138129 22194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.132351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:55663 (local address 127.7.113.194:38421)
0806 04:48:29.132552 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:29.132561 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:29.132636 (+ 75us) server_negotiation.cc:407] Connection header received
0806 04:48:29.132885 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:29.132894 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:29.132980 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:29.133085 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:29.133680 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.134536 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.136501 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.137235 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.137346 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.137393 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:29.137730 (+ 337us) server_negotiation.cc:299] Negotiation successful
0806 04:48:29.137857 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 04:48:29.139333 22198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.132486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:50199 (local address 127.7.113.193:43845)
0806 04:48:29.132701 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:29.132708 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:29.133802 (+ 1094us) server_negotiation.cc:407] Connection header received
0806 04:48:29.133975 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:29.133980 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:29.134048 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:29.134173 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:29.134730 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.135491 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.137463 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.138547 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.138662 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.138709 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:29.139066 (+ 357us) server_negotiation.cc:299] Negotiation successful
0806 04:48:29.139151 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 04:48:29.139169 22000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29a4c74d9c84959b4e87626a01cbd83" candidate_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" is_pre_election: true
I20260806 04:48:29.139497 22208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.132828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43845 (local address 127.7.113.195:50199)
0806 04:48:29.133701 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:29.133717 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:29.133851 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:29.134212 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:29.134216 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:29.134243 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:29.134551 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:29.134560 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.135676 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.135682 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:29.137260 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:29.137271 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.138738 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.138744 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:29.138915 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.138945 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 04:48:29.139048 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 04:48:29.139169 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":743,"thread_start_us":465,"threads_started":1}
I20260806 04:48:29.139737 22000 raft_consensus.cc:2454] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c6f2aa11f744f1b5eb399846e690fa in term 0.
I20260806 04:48:29.140359 22205 raft_consensus.cc:482] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:48:29.140522 22070 leader_election.cc:302] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8c6f2aa11f744f1b5eb399846e690fa, ade63e40c1c44d2c8ac92aa00741daf7; no voters:
I20260806 04:48:29.140942 22206 raft_consensus.cc:2781] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:48:29.140688 22205 raft_consensus.cc:504] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } }
I20260806 04:48:29.140700 21862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29a4c74d9c84959b4e87626a01cbd83" candidate_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97367e709a464999bb6334ba7518a37c" is_pre_election: true
I20260806 04:48:29.141099 22206 raft_consensus.cc:482] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:48:29.141271 22206 raft_consensus.cc:3037] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:29.141543 21862 raft_consensus.cc:2454] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c6f2aa11f744f1b5eb399846e690fa in term 0.
I20260806 04:48:29.142596 22205 leader_election.cc:288] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421), a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219)
I20260806 04:48:29.145926 22206 raft_consensus.cc:504] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } }
I20260806 04:48:29.147133 22000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29a4c74d9c84959b4e87626a01cbd83" candidate_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade63e40c1c44d2c8ac92aa00741daf7"
I20260806 04:48:29.147274 22206 leader_election.cc:288] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [CANDIDATE]: Term 1 election: Requested vote from peers ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421), 97367e709a464999bb6334ba7518a37c (127.7.113.193:43845)
I20260806 04:48:29.147358 22000 raft_consensus.cc:3037] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:29.147390 21862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29a4c74d9c84959b4e87626a01cbd83" candidate_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97367e709a464999bb6334ba7518a37c"
I20260806 04:48:29.147573 21862 raft_consensus.cc:3037] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [term 0 FOLLOWER]: Advancing to term 1
W20260806 04:48:29.148723 21909 tablet.cc:2369] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:48:29.150743 22000 raft_consensus.cc:2454] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c6f2aa11f744f1b5eb399846e690fa in term 1.
I20260806 04:48:29.151154 22070 leader_election.cc:302] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8c6f2aa11f744f1b5eb399846e690fa, ade63e40c1c44d2c8ac92aa00741daf7; no voters:
I20260806 04:48:29.151222 21862 raft_consensus.cc:2454] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c6f2aa11f744f1b5eb399846e690fa in term 1.
I20260806 04:48:29.151530 22206 raft_consensus.cc:2781] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:48:29.154188 22194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.143200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:48103 (local address 127.7.113.194:38421)
0806 04:48:29.143699 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:29.143705 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:29.143720 (+ 15us) server_negotiation.cc:407] Connection header received
0806 04:48:29.143769 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:29.143773 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:29.143830 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:29.143911 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:29.144619 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.145345 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.150430 (+ 5085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.152658 (+ 2228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.152827 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.152929 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:29.153645 (+ 716us) server_negotiation.cc:299] Negotiation successful
0806 04:48:29.153841 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391}
I20260806 04:48:29.154464 22209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.142720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:38421 (local address 127.7.113.193:48103)
0806 04:48:29.143601 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:29.143613 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:29.143698 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:29.144035 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:29.144038 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:29.144060 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:29.144492 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:29.144502 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.145467 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.145474 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:29.150196 (+ 4722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:29.150217 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.153171 (+ 2954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.153179 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:29.153437 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.153488 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 04:48:29.153600 (+ 112us) client_negotiation.cc:240] Negotiation successful
0806 04:48:29.153778 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":782,"thread_start_us":623,"threads_started":1}
I20260806 04:48:29.155493 22000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29a4c74d9c84959b4e87626a01cbd83" candidate_uuid: "97367e709a464999bb6334ba7518a37c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" is_pre_election: true
I20260806 04:48:29.155887 22000 raft_consensus.cc:2379] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97367e709a464999bb6334ba7518a37c in current term 1: Already voted for candidate a8c6f2aa11f744f1b5eb399846e690fa in this term.
I20260806 04:48:29.158377 22206 raft_consensus.cc:686] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [term 1 LEADER]: Becoming Leader. State: Replica: a8c6f2aa11f744f1b5eb399846e690fa, State: Running, Role: LEADER
I20260806 04:48:29.158880 22206 consensus_queue.cc:237] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } }
I20260806 04:48:29.160198 22196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.143393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:58153 (local address 127.7.113.195:43219)
0806 04:48:29.143568 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:29.143574 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:29.154838 (+ 11264us) server_negotiation.cc:407] Connection header received
0806 04:48:29.155111 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:29.155119 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:29.155221 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:29.155288 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:29.155803 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.156680 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.158145 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.159353 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.159513 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.159583 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:29.159911 (+ 328us) server_negotiation.cc:299] Negotiation successful
0806 04:48:29.160021 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 04:48:29.160807 22209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.142991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:43219 (local address 127.7.113.193:58153)
0806 04:48:29.154735 (+ 11744us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:29.154758 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:29.154947 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:29.155491 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:29.155495 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:29.155518 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:29.155681 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:29.155692 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.156804 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.156810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:29.157982 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:29.158002 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.159501 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.159506 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:29.159703 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.159726 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 04:48:29.160449 (+ 723us) client_negotiation.cc:240] Negotiation successful
0806 04:48:29.160557 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11622,"thread_start_us":12514,"threads_started":1}
I20260806 04:48:29.161743 22135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29a4c74d9c84959b4e87626a01cbd83" candidate_uuid: "97367e709a464999bb6334ba7518a37c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" is_pre_election: true
I20260806 04:48:29.162878 21794 leader_election.cc:302] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97367e709a464999bb6334ba7518a37c; no voters: a8c6f2aa11f744f1b5eb399846e690fa, ade63e40c1c44d2c8ac92aa00741daf7
I20260806 04:48:29.163232 22205 raft_consensus.cc:2726] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 04:48:29.163854 21712 catalog_manager.cc:5495] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195). New cstate: current_term: 1 leader_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } health_report { overall_health: UNKNOWN } } }
W20260806 04:48:29.171607 22046 tablet.cc:2369] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:48:29.186232 22196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.181181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48288 (local address 127.7.113.195:43219)
0806 04:48:29.181372 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:29.181381 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:29.181531 (+ 150us) server_negotiation.cc:407] Connection header received
0806 04:48:29.181682 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:29.181696 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:29.181763 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:29.181876 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:48:29.182230 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.183026 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.184340 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.184719 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.184813 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.185211 (+ 398us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:48:29.185662 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:48:29.185772 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:29.185858 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 04:48:29.185913 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260806 04:48:29.187680 22181 tablet.cc:2369] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:48:29.193972 22000 raft_consensus.cc:1261] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7 [term 1 FOLLOWER]: Refusing update from remote peer a8c6f2aa11f744f1b5eb399846e690fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:48:29.194011 21862 raft_consensus.cc:1261] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Refusing update from remote peer a8c6f2aa11f744f1b5eb399846e690fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:48:29.194866 22211 consensus_queue.cc:1035] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:48:29.195223 22206 consensus_queue.cc:1035] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:48:29.206054 22214 mvcc.cc:205] Tried to move back new op lower bound from 7315422040848756736 to 7315422040718839808. Current Snapshot: MvccSnapshot[applied={T|T < 7315422040848756736}]
I20260806 04:48:29.219023 21713 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:48:29.219302 21713 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:48:29.222685 21713 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Sending DeleteTablet for 3 replicas of tablet e29a4c74d9c84959b4e87626a01cbd83
I20260806 04:48:29.223767 22114 tablet_service.cc:1514] Processing DeleteTablet for tablet e29a4c74d9c84959b4e87626a01cbd83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:48:29 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:48274
I20260806 04:48:29.223764 21980 tablet_service.cc:1514] Processing DeleteTablet for tablet e29a4c74d9c84959b4e87626a01cbd83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:48:29 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:49274
I20260806 04:48:29.224016 21841 tablet_service.cc:1514] Processing DeleteTablet for tablet e29a4c74d9c84959b4e87626a01cbd83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:48:29 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:52556
I20260806 04:48:29.224761 22226 tablet_replica.cc:330] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7: stopping tablet replica
I20260806 04:48:29.224947 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 21774
I20260806 04:48:29.225277 22226 raft_consensus.cc:2229] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:48:29.225831 22226 raft_consensus.cc:2258] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:48:29.226740 22225 tablet_replica.cc:330] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa: stopping tablet replica
I20260806 04:48:29.227213 22225 raft_consensus.cc:2229] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:48:29.227933 22225 raft_consensus.cc:2258] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:48:29.228199 22226 ts_tablet_manager.cc:1905] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:48:29.233603 22227 tablet_replica.cc:330] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c: stopping tablet replica
I20260806 04:48:29.234110 22227 raft_consensus.cc:2229] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:48:29.234750 22227 raft_consensus.cc:2258] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:48:29.236001 22226 ts_tablet_manager.cc:1918] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:48:29.236143 22226 log.cc:1196] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/e29a4c74d9c84959b4e87626a01cbd83
I20260806 04:48:29.236668 22226 ts_tablet_manager.cc:1939] T e29a4c74d9c84959b4e87626a01cbd83 P ade63e40c1c44d2c8ac92aa00741daf7: Deleting consensus metadata
I20260806 04:48:29.236744 22227 ts_tablet_manager.cc:1905] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:48:29.238139 22225 ts_tablet_manager.cc:1905] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:48:29.238336 21700 catalog_manager.cc:4841] TS ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421): tablet e29a4c74d9c84959b4e87626a01cbd83 (table test-table [id=9bf1501ea29c4f0c9f109434885c4dd6]) successfully deleted
I20260806 04:48:29.243542 22227 ts_tablet_manager.cc:1918] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:48:29.243701 22227 log.cc:1196] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/e29a4c74d9c84959b4e87626a01cbd83
I20260806 04:48:29.244215 22227 ts_tablet_manager.cc:1939] T e29a4c74d9c84959b4e87626a01cbd83 P 97367e709a464999bb6334ba7518a37c: Deleting consensus metadata
I20260806 04:48:29.245730 22225 ts_tablet_manager.cc:1918] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Aug 06 04:48:29 dist-test-slave-0b58 krb5kdc[21667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:48:29.245832 21697 catalog_manager.cc:4841] TS 97367e709a464999bb6334ba7518a37c (127.7.113.193:43845): tablet e29a4c74d9c84959b4e87626a01cbd83 (table test-table [id=9bf1501ea29c4f0c9f109434885c4dd6]) successfully deleted
I20260806 04:48:29.246039 22225 log.cc:1196] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/e29a4c74d9c84959b4e87626a01cbd83
I20260806 04:48:29.246562 22225 ts_tablet_manager.cc:1939] T e29a4c74d9c84959b4e87626a01cbd83 P a8c6f2aa11f744f1b5eb399846e690fa: Deleting consensus metadata
I20260806 04:48:29.248138 21699 catalog_manager.cc:4841] TS a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219): tablet e29a4c74d9c84959b4e87626a01cbd83 (table test-table [id=9bf1501ea29c4f0c9f109434885c4dd6]) successfully deleted
I20260806 04:48:29.253368 22198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.226026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52562 (local address 127.7.113.193:43845)
0806 04:48:29.226228 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:29.226241 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:29.232862 (+ 6621us) server_negotiation.cc:407] Connection header received
0806 04:48:29.233083 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:29.233090 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:29.233204 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:29.233342 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:29.235518 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.236714 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.240697 (+ 3983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.241389 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.241489 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.247047 (+ 5558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:29.247060 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:29.247075 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:29.247112 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:29.250251 (+ 3139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:29.251233 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:29.251242 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:29.251245 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:29.251376 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:29.251847 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:29.251857 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:29.251860 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:29.252345 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:29.252609 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:29.252913 (+ 304us) server_negotiation.cc:299] Negotiation successful
0806 04:48:29.253065 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 04:48:29.253958 21903 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:29.343766 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 21774
I20260806 04:48:29.363950 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 21914
Aug 06 04:48:29 dist-test-slave-0b58 krb5kdc[21667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:48:29.380416 22194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.364806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49284 (local address 127.7.113.194:38421)
0806 04:48:29.364974 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:29.364978 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:29.365014 (+ 36us) server_negotiation.cc:407] Connection header received
0806 04:48:29.365236 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:29.365240 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:29.365312 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:29.365400 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:29.367048 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.367739 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.369600 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.369978 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.370073 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.374747 (+ 4674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:29.374760 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:29.374774 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:29.374806 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:29.377654 (+ 2848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:29.378361 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:29.378368 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:29.378370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:29.378489 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:29.378876 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:29.378882 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:29.378885 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:29.379211 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:29.379520 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:29.379801 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 04:48:29.380015 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 04:48:29.381155 22040 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:29.468420 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 21914
I20260806 04:48:29.488003 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 22051
Aug 06 04:48:29 dist-test-slave-0b58 krb5kdc[21667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:48:29.504491 22196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:29.488873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48292 (local address 127.7.113.195:43219)
0806 04:48:29.489065 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:29.489073 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:29.489097 (+ 24us) server_negotiation.cc:407] Connection header received
0806 04:48:29.489337 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:29.489349 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:29.489428 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:29.489538 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:29.490899 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.491645 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.493055 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:29.493513 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:29.493655 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:29.498319 (+ 4664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:29.498330 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:29.498353 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:29.498389 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:29.501541 (+ 3152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:29.502226 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:29.502242 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:29.502245 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:29.502376 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:29.502785 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:29.502790 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:29.502794 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:29.503218 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:29.503554 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:29.503840 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 04:48:29.504073 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 04:48:29.505225 22175 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:29.624878 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 22051
I20260806 04:48:29.646512 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 21681
I20260806 04:48:29.647564 21743 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:29.756723 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 21681
I20260806 04:48:29.780193 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:38423
--webserver_interface=127.7.113.254
--webserver_port=44321
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:38423
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:30.104442 22233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:30.104691 22233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:30.104928 22233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:30.111853 22233 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:48:30.111958 22233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:30.112003 22233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:30.112097 22233 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:48:30.112161 22233 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:48:30.121290 22233 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:38423
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:38423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=44321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:30.122439 22233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:30.123673 22233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:30.148900 22240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:30.148866 22242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:30.148932 22239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:30.149789 22233 server_base.cc:1034] running on GCE node
I20260806 04:48:30.150604 22233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:30.152140 22233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:30.153375 22233 hybrid_clock.cc:648] HybridClock initialized: now 1785991710153318 us; error 47 us; skew 500 ppm
I20260806 04:48:30.153806 22233 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:30 dist-test-slave-0b58 krb5kdc[21667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991710, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:30.157467 22233 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:48:30.159035 22233 webserver.cc:460] Webserver started at http://127.7.113.254:44321/ using document root <none> and password file <none>
I20260806 04:48:30.159778 22233 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:30.159946 22233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:30.165763 22233 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 04:48:30.168694 22249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:30.169930 22233 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:48:30.170114 22233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "547a882df57f4b118b75e5da3a11e9e0"
format_stamp: "Formatted at 2026-08-06 04:48:27 on dist-test-slave-0b58"
server_key: "134ec814ee3c98ef9032da6934b0a928"
server_key_iv: "47d09e0bea721e074e82a62ee6080790"
server_key_version: "encryptionkey@0"
I20260806 04:48:30.171170 22233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:30.187878 22233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:30.191675 22233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:30.191959 22233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:30.210848 22233 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:38423
I20260806 04:48:30.210865 22301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:38423 every 8 connection(s)
I20260806 04:48:30.212390 22233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:48:30.215304 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 22233
I20260806 04:48:30.216120 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:43845
--local_ip_for_outbound_sockets=127.7.113.193
--tserver_master_addrs=127.7.113.254:38423
--webserver_port=36355
--webserver_interface=127.7.113.193
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:48:30.219135 22302 sys_catalog.cc:263] Verifying existing consensus state
I20260806 04:48:30.222456 22302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Bootstrap starting.
I20260806 04:48:30.251014 22302 log.cc:824] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:30.265928 22302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 04:48:30.266548 22302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Bootstrap complete.
I20260806 04:48:30.280207 22302 raft_consensus.cc:348] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } }
I20260806 04:48:30.281440 22302 raft_consensus.cc:729] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 547a882df57f4b118b75e5da3a11e9e0, State: Initialized, Role: FOLLOWER
I20260806 04:48:30.282145 22302 consensus_queue.cc:260] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } }
I20260806 04:48:30.282485 22302 raft_consensus.cc:388] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:48:30.282648 22302 raft_consensus.cc:482] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:48:30.282860 22302 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 1 FOLLOWER]: Advancing to term 2
I20260806 04:48:30.288691 22302 raft_consensus.cc:504] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } }
I20260806 04:48:30.289419 22302 leader_election.cc:302] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 547a882df57f4b118b75e5da3a11e9e0; no voters:
I20260806 04:48:30.290158 22302 leader_election.cc:288] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 04:48:30.290295 22306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 04:48:30.291822 22306 raft_consensus.cc:686] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 2 LEADER]: Becoming Leader. State: Replica: 547a882df57f4b118b75e5da3a11e9e0, State: Running, Role: LEADER
I20260806 04:48:30.292475 22306 consensus_queue.cc:237] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } }
I20260806 04:48:30.292689 22302 sys_catalog.cc:564] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:48:30.294926 22308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 547a882df57f4b118b75e5da3a11e9e0. Latest consensus state: current_term: 2 leader_uuid: "547a882df57f4b118b75e5da3a11e9e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } } }
I20260806 04:48:30.295286 22308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:30.295786 22307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "547a882df57f4b118b75e5da3a11e9e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } } }
I20260806 04:48:30.296118 22307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:30.306306 22312 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:48:30.314018 22312 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:48:30.315446 22312 catalog_manager.cc:1259] Loaded cluster ID: ae16232fc6454b549a96345a7a1ce1f3
I20260806 04:48:30.315598 22312 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:48:30.318651 22312 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260806 04:48:30.337399 22312 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260806 04:48:30.354956 22324 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 04:48:30.357372 22312 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:48:30.359364 22312 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Loaded TSK: 0
I20260806 04:48:30.360890 22312 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 04:48:30.589881 22304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:30.590134 22304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:30.590298 22304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:30.597781 22304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:30.597909 22304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:30.598126 22304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:48:30.607776 22304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:43845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=36355
--tserver_master_addrs=127.7.113.254:38423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:30.609115 22304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:30.610443 22304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:30.629189 22330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:30.629132 22329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:30.630409 22332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:30.630745 22304 server_base.cc:1034] running on GCE node
I20260806 04:48:30.631373 22304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:30.632462 22304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:30.633680 22304 hybrid_clock.cc:648] HybridClock initialized: now 1785991710633633 us; error 41 us; skew 500 ppm
I20260806 04:48:30.633992 22304 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:30 dist-test-slave-0b58 krb5kdc[21667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991710, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:30.641822 22304 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:48:30.643435 22304 webserver.cc:460] Webserver started at http://127.7.113.193:36355/ using document root <none> and password file <none>
I20260806 04:48:30.644125 22304 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:30.644296 22304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:30.649639 22304 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:48:30.652351 22339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:30.653759 22304 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:48:30.653913 22304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "97367e709a464999bb6334ba7518a37c"
format_stamp: "Formatted at 2026-08-06 04:48:27 on dist-test-slave-0b58"
server_key: "bce963b592c513dd21b67843731e0e8d"
server_key_iv: "bddf3c51c3c0e1c4435f457d97742daf"
server_key_version: "encryptionkey@0"
I20260806 04:48:30.654983 22304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:30.667608 22304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:30.671700 22304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:30.671976 22304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:30.673116 22304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:30.674669 22304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:30.674789 22304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:30.674911 22304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:30.675010 22304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:30.709863 22304 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:43845
I20260806 04:48:30.709947 22453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:43845 every 8 connection(s)
I20260806 04:48:30.711308 22304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:48:30.720212 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 22304
I20260806 04:48:30.720943 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:38421
--local_ip_for_outbound_sockets=127.7.113.194
--tserver_master_addrs=127.7.113.254:38423
--webserver_port=44285
--webserver_interface=127.7.113.194
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 04:48:30 dist-test-slave-0b58 krb5kdc[21667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991710, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:30.734719 22457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:30.714499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:36551)
0806 04:48:30.715303 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:30.715353 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:30.717100 (+ 1747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:30.718268 (+ 1168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:30.718274 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:30.718737 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:30.719227 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:30.719241 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:30.720931 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:30.720937 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:30.723073 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:30.723091 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:30.724057 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:30.724066 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:30.724414 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:30.725102 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:30.725133 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:30.727723 (+ 2590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:30.730932 (+ 3209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:30.730940 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:30.730953 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:30.731378 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:30.731881 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:30.731884 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:30.731887 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:30.732057 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:30.733035 (+ 978us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:30.733041 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:30.733303 (+ 262us) client_negotiation.cc:769] Sending connection context
0806 04:48:30.733523 (+ 220us) client_negotiation.cc:240] Negotiation successful
0806 04:48:30.733850 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":352,"threads_started":1}
I20260806 04:48:30.735329 22456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:30.714187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:36551 (local address 127.7.113.254:38423)
0806 04:48:30.714796 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:30.714807 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:30.715473 (+ 666us) server_negotiation.cc:407] Connection header received
0806 04:48:30.717551 (+ 2078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:30.717563 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:30.717857 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:30.718129 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:30.719438 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:30.720767 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:30.723246 (+ 2479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:30.723840 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:30.723969 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:30.727986 (+ 4017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:30.727994 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:30.728006 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:30.728041 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:30.730791 (+ 2750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:30.731513 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:30.731524 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:30.731534 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:30.731755 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:30.732170 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:30.732177 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:30.732182 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:30.732906 (+ 724us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:30.733102 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:30.733750 (+ 648us) server_negotiation.cc:299] Negotiation successful
0806 04:48:30.734164 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":278,"threads_started":1}
I20260806 04:48:30.737902 22454 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38423
I20260806 04:48:30.738196 22454 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:30.739040 22454 heartbeater.cc:511] Master 127.7.113.254:38423 requested a full tablet report, sending...
I20260806 04:48:30.741295 22266 ts_manager.cc:194] Registered new tserver with Master: 97367e709a464999bb6334ba7518a37c (127.7.113.193:43845)
I20260806 04:48:30.742825 22266 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:36551
W20260806 04:48:31.054755 22458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:31.055035 22458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:31.055126 22458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:31.062441 22458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:31.062574 22458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:31.062747 22458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:48:31.071939 22458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:38421
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=44285
--tserver_master_addrs=127.7.113.254:38423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:31.073293 22458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:31.074630 22458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:31.087607 22463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:31.087656 22466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:31.087693 22464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:31.088500 22458 server_base.cc:1034] running on GCE node
I20260806 04:48:31.089116 22458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:31.090013 22458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:31.091243 22458 hybrid_clock.cc:648] HybridClock initialized: now 1785991711091186 us; error 46 us; skew 500 ppm
I20260806 04:48:31.091542 22458 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:31 dist-test-slave-0b58 krb5kdc[21667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991711, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:31.094642 22458 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:48:31.095990 22458 webserver.cc:460] Webserver started at http://127.7.113.194:44285/ using document root <none> and password file <none>
I20260806 04:48:31.096700 22458 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:31.096873 22458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:31.101897 22458 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 04:48:31.104446 22474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:31.105651 22458 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 04:48:31.105830 22458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "ade63e40c1c44d2c8ac92aa00741daf7"
format_stamp: "Formatted at 2026-08-06 04:48:28 on dist-test-slave-0b58"
server_key: "26aa5f807c60c59641d992dff8c5f787"
server_key_iv: "1246258b6619252a8ff664ab3d835ff4"
server_key_version: "encryptionkey@0"
I20260806 04:48:31.106804 22458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:31.129658 22458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:31.133538 22458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:31.133817 22458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:31.134812 22458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:31.136885 22458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:31.137004 22458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:31.137133 22458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:31.137214 22458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:31.170749 22458 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:38421
I20260806 04:48:31.170843 22588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:38421 every 8 connection(s)
I20260806 04:48:31.172238 22458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:48:31.181733 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 22458
I20260806 04:48:31.182343 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:43219
--local_ip_for_outbound_sockets=127.7.113.195
--tserver_master_addrs=127.7.113.254:38423
--webserver_port=41687
--webserver_interface=127.7.113.195
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 04:48:31 dist-test-slave-0b58 krb5kdc[21667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991711, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:31.192061 22456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.174904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:37829 (local address 127.7.113.254:38423)
0806 04:48:31.175081 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:31.175086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:31.176275 (+ 1189us) server_negotiation.cc:407] Connection header received
0806 04:48:31.178162 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:31.178167 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:31.178252 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:31.178379 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:31.179801 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.180620 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.182209 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.182763 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.182895 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.186521 (+ 3626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:31.186525 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:31.186529 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:31.186560 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:31.189071 (+ 2511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:31.189812 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:31.189816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:31.189818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:31.189959 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:31.190383 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:31.190390 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:31.190393 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:31.190668 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:31.190833 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:31.191478 (+ 645us) server_negotiation.cc:299] Negotiation successful
0806 04:48:31.191708 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 04:48:31.193111 22591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.175405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:37829)
0806 04:48:31.176098 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:31.176136 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:31.177897 (+ 1761us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:31.178616 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:31.178624 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:31.179103 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:31.179632 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:31.179648 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.180774 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.180789 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:31.182052 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:31.182063 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.182981 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.182988 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:31.183214 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.183909 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:31.183929 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:31.186314 (+ 2385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:31.189210 (+ 2896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:31.189218 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:31.189245 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:31.189676 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:31.190069 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:31.190074 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:31.190078 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:31.190263 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:31.190794 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:31.190802 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:31.191121 (+ 319us) client_negotiation.cc:769] Sending connection context
0806 04:48:31.191385 (+ 264us) client_negotiation.cc:240] Negotiation successful
0806 04:48:31.191879 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":266,"threads_started":1}
I20260806 04:48:31.194577 22589 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38423
I20260806 04:48:31.194891 22589 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:31.195686 22589 heartbeater.cc:511] Master 127.7.113.254:38423 requested a full tablet report, sending...
I20260806 04:48:31.197199 22266 ts_manager.cc:194] Registered new tserver with Master: ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421)
I20260806 04:48:31.197963 22266 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:37829
W20260806 04:48:31.511929 22592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:31.512198 22592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:31.512421 22592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:31.519269 22592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:31.519367 22592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:31.519572 22592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:48:31.529327 22592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:43219
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=41687
--tserver_master_addrs=127.7.113.254:38423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:31.530634 22592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:31.531893 22592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:31.545279 22597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:31.545305 22600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:31.545265 22598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:31.546092 22592 server_base.cc:1034] running on GCE node
I20260806 04:48:31.546726 22592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:31.547669 22592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:31.548887 22592 hybrid_clock.cc:648] HybridClock initialized: now 1785991711548825 us; error 54 us; skew 500 ppm
I20260806 04:48:31.549187 22592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:31 dist-test-slave-0b58 krb5kdc[21667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991711, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:31.552165 22592 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:48:31.553555 22592 webserver.cc:460] Webserver started at http://127.7.113.195:41687/ using document root <none> and password file <none>
I20260806 04:48:31.554209 22592 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:31.554371 22592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:31.559648 22592 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:48:31.562321 22607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:31.563582 22592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:48:31.563753 22592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "a8c6f2aa11f744f1b5eb399846e690fa"
format_stamp: "Formatted at 2026-08-06 04:48:28 on dist-test-slave-0b58"
server_key: "5c1b7a3f851623b68274fc59c70f6097"
server_key_iv: "e5927006b4d03b161e533e8675d8178c"
server_key_version: "encryptionkey@0"
I20260806 04:48:31.564777 22592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:31.583068 22592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:31.586665 22592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:31.586925 22592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:31.587846 22592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:31.589159 22592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:31.589278 22592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:31.589412 22592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:31.589500 22592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:31.622385 22592 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:43219
I20260806 04:48:31.622435 22720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:43219 every 8 connection(s)
I20260806 04:48:31.623792 22592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:48:31.631933 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 22592
Aug 06 04:48:31 dist-test-slave-0b58 krb5kdc[21667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991711, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:31.644677 22456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.626293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:44901 (local address 127.7.113.254:38423)
0806 04:48:31.626507 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:31.626513 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:31.627680 (+ 1167us) server_negotiation.cc:407] Connection header received
0806 04:48:31.629434 (+ 1754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:31.629438 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:31.629502 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:31.629587 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:31.630943 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.631658 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.633902 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.634535 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.634620 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.638602 (+ 3982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:31.638607 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:31.638612 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:31.638651 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:31.641432 (+ 2781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:31.642260 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:31.642264 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:31.642266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:31.642394 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:31.642828 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:31.642833 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:31.642837 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:31.643212 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:31.643408 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:31.644029 (+ 621us) server_negotiation.cc:299] Negotiation successful
0806 04:48:31.644249 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 04:48:31.645560 22723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.626816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:44901)
0806 04:48:31.627495 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:31.627539 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:31.629207 (+ 1668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:31.629777 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:31.629783 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:31.630247 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:31.630778 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:31.630793 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.631815 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.631820 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:31.633758 (+ 1938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:31.633775 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.634790 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.634798 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:31.635103 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.635820 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:31.635859 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:31.638330 (+ 2471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:31.641568 (+ 3238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:31.641579 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:31.641594 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:31.642156 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:31.642511 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:31.642518 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:31.642521 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:31.642696 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:31.643345 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:31.643354 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:31.643673 (+ 319us) client_negotiation.cc:769] Sending connection context
0806 04:48:31.643924 (+ 251us) client_negotiation.cc:240] Negotiation successful
0806 04:48:31.644454 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":273,"threads_started":1}
I20260806 04:48:31.646958 22721 heartbeater.cc:347] Connected to a master server at 127.7.113.254:38423
I20260806 04:48:31.647249 22721 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:31.647912 22721 heartbeater.cc:511] Master 127.7.113.254:38423 requested a full tablet report, sending...
I20260806 04:48:31.649371 22724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.632972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35076 (local address 127.7.113.254:38423)
0806 04:48:31.633490 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:31.633497 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:31.633822 (+ 325us) server_negotiation.cc:407] Connection header received
0806 04:48:31.634019 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:31.634024 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:31.634087 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:31.634188 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:31.636117 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.636897 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.638600 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.639313 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.639431 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.642388 (+ 2957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:31.642393 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:31.642395 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:31.642424 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:31.645301 (+ 2877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:31.646011 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:31.646019 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:31.646025 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:31.646164 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:31.646555 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:31.646560 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:31.646564 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:31.646822 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:31.647085 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:31.648793 (+ 1708us) server_negotiation.cc:299] Negotiation successful
0806 04:48:31.649010 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":259,"threads_started":1}
I20260806 04:48:31.649439 22266 ts_manager.cc:194] Registered new tserver with Master: a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219)
I20260806 04:48:31.650341 22266 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:44901
I20260806 04:48:31.651916 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:48:31.658636 22724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.652990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35086 (local address 127.7.113.254:38423)
0806 04:48:31.653214 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:31.653222 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:31.653523 (+ 301us) server_negotiation.cc:407] Connection header received
0806 04:48:31.653729 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:31.653734 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:31.653856 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:31.653993 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:48:31.654434 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.655090 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.656579 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.657014 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.657144 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.657606 (+ 462us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:48:31.658134 (+ 528us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:48:31.658298 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:31.658415 (+ 117us) server_negotiation.cc:299] Negotiation successful
0806 04:48:31.658472 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 04:48:31.659528 22265 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:35086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:48:31.666630 22265 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:48:31.699776 22733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.678149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43845 (local address 127.0.0.1:39448)
0806 04:48:31.690615 (+ 12466us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:31.690637 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:31.690779 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:31.691919 (+ 1140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:31.691930 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:31.691967 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:31.692513 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:31.692529 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.694586 (+ 2057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.694592 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:31.697143 (+ 2551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:31.697158 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.698830 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.698836 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:31.699026 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.699078 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 04:48:31.699220 (+ 142us) client_negotiation.cc:240] Negotiation successful
0806 04:48:31.699408 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12289,"thread_start_us":12115,"threads_started":1}
I20260806 04:48:31.699776 22735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.678836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39448 (local address 127.7.113.193:43845)
0806 04:48:31.690041 (+ 11205us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:31.690052 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:31.690940 (+ 888us) server_negotiation.cc:407] Connection header received
0806 04:48:31.691065 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:31.691076 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:31.691370 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:31.691586 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:31.692786 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.694445 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.697288 (+ 2843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.698603 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.698762 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.698963 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:31.699271 (+ 308us) server_negotiation.cc:299] Negotiation successful
0806 04:48:31.699444 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10988,"thread_start_us":10831,"threads_started":1}
I20260806 04:48:31.700795 22731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.678632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:43219 (local address 127.0.0.1:53358)
0806 04:48:31.692758 (+ 14126us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:31.692778 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:31.692911 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:31.694051 (+ 1140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:31.694056 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:31.694083 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:31.694501 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:31.694516 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.695883 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.695892 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:31.697929 (+ 2037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:31.697944 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.699995 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.700001 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:31.700164 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.700199 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 04:48:31.700331 (+ 132us) client_negotiation.cc:240] Negotiation successful
0806 04:48:31.700462 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14022,"thread_start_us":9746,"threads_started":1}
I20260806 04:48:31.701555 22736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.679537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53358 (local address 127.7.113.195:43219)
0806 04:48:31.688055 (+ 8518us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:31.688063 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:31.692874 (+ 4811us) server_negotiation.cc:407] Connection header received
0806 04:48:31.693102 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:31.693114 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:31.693278 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:31.693453 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:31.694794 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.695746 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.698116 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.699506 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.699621 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.699848 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:31.701040 (+ 1192us) server_negotiation.cc:299] Negotiation successful
0806 04:48:31.701208 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8334,"thread_start_us":8174,"threads_started":1}
I20260806 04:48:31.702805 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.677889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:38421 (local address 127.0.0.1:42896)
0806 04:48:31.688133 (+ 10244us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:31.688198 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:31.689337 (+ 1139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:31.694534 (+ 5197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:31.694539 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:31.694572 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:31.695069 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:31.695079 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.697082 (+ 2003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.697087 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:31.699270 (+ 2183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:31.699294 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.701171 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.701177 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:31.701382 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.701424 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 04:48:31.701490 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 04:48:31.701626 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9993,"thread_start_us":14611,"threads_started":1}
I20260806 04:48:31.703018 22732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.678124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42896 (local address 127.7.113.194:38421)
0806 04:48:31.693864 (+ 15740us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:31.693872 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:31.693903 (+ 31us) server_negotiation.cc:407] Connection header received
0806 04:48:31.693992 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:31.693998 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:31.694172 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:31.695251 (+ 1079us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:31.695453 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.696939 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.699468 (+ 2529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.700930 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.702073 (+ 1143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.702498 (+ 425us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:31.702570 (+ 72us) server_negotiation.cc:299] Negotiation successful
0806 04:48:31.702714 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15566,"thread_start_us":16152,"threads_started":1}
I20260806 04:48:31.704196 22387 tablet_service.cc:1467] Processing CreateTablet for tablet 3b8614becc2142dd9f15b7290c011326 (DEFAULT_TABLE table=test-table [id=6b0d11f6a483442da7c5975fa9960465]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:48:31.705436 22387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b8614becc2142dd9f15b7290c011326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:31.704973 22655 tablet_service.cc:1467] Processing CreateTablet for tablet 3b8614becc2142dd9f15b7290c011326 (DEFAULT_TABLE table=test-table [id=6b0d11f6a483442da7c5975fa9960465]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:48:31.706339 22655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b8614becc2142dd9f15b7290c011326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:31.706457 22522 tablet_service.cc:1467] Processing CreateTablet for tablet 3b8614becc2142dd9f15b7290c011326 (DEFAULT_TABLE table=test-table [id=6b0d11f6a483442da7c5975fa9960465]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:48:31.707777 22522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b8614becc2142dd9f15b7290c011326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:31.722831 22737 tablet_bootstrap.cc:492] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: Bootstrap starting.
I20260806 04:48:31.726440 22737 tablet_bootstrap.cc:654] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:31.727283 22738 tablet_bootstrap.cc:492] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7: Bootstrap starting.
I20260806 04:48:31.727798 22737 log.cc:824] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:31.728223 22739 tablet_bootstrap.cc:492] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa: Bootstrap starting.
I20260806 04:48:31.731057 22738 tablet_bootstrap.cc:654] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:31.732117 22738 log.cc:824] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:31.732820 22739 tablet_bootstrap.cc:654] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:31.734426 22739 log.cc:824] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:31.735215 22737 tablet_bootstrap.cc:492] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: No bootstrap required, opened a new log
I20260806 04:48:31.735517 22737 ts_tablet_manager.cc:1397] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20260806 04:48:31.736963 22739 tablet_bootstrap.cc:492] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa: No bootstrap required, opened a new log
I20260806 04:48:31.737214 22739 ts_tablet_manager.cc:1397] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 04:48:31.737326 22738 tablet_bootstrap.cc:492] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7: No bootstrap required, opened a new log
I20260806 04:48:31.737576 22738 ts_tablet_manager.cc:1397] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260806 04:48:31.744938 22739 raft_consensus.cc:348] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:31.745314 22739 raft_consensus.cc:374] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:31.745452 22739 raft_consensus.cc:729] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c6f2aa11f744f1b5eb399846e690fa, State: Initialized, Role: FOLLOWER
I20260806 04:48:31.746045 22739 consensus_queue.cc:260] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:31.746419 22454 heartbeater.cc:503] Master 127.7.113.254:38423 was elected leader, sending a full tablet report...
I20260806 04:48:31.746179 22737 raft_consensus.cc:348] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:31.746636 22737 raft_consensus.cc:374] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:31.746734 22737 raft_consensus.cc:729] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97367e709a464999bb6334ba7518a37c, State: Initialized, Role: FOLLOWER
I20260806 04:48:31.747365 22737 consensus_queue.cc:260] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:31.747859 22738 raft_consensus.cc:348] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:31.748366 22738 raft_consensus.cc:374] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:31.748529 22738 raft_consensus.cc:729] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade63e40c1c44d2c8ac92aa00741daf7, State: Initialized, Role: FOLLOWER
I20260806 04:48:31.748250 22721 heartbeater.cc:503] Master 127.7.113.254:38423 was elected leader, sending a full tablet report...
I20260806 04:48:31.748950 22739 ts_tablet_manager.cc:1428] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260806 04:48:31.749235 22738 consensus_queue.cc:260] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:31.753540 22737 ts_tablet_manager.cc:1428] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: Time spent starting tablet: real 0.018s user 0.012s sys 0.003s
I20260806 04:48:31.754500 22589 heartbeater.cc:503] Master 127.7.113.254:38423 was elected leader, sending a full tablet report...
I20260806 04:48:31.755111 22738 ts_tablet_manager.cc:1428] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
W20260806 04:48:31.875455 22722 tablet.cc:2369] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:48:31.924496 22590 tablet.cc:2369] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:48:31.938771 22743 raft_consensus.cc:482] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:48:31.939038 22743 raft_consensus.cc:504] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:31.940829 22743 leader_election.cc:288] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421), 97367e709a464999bb6334ba7518a37c (127.7.113.193:43845)
I20260806 04:48:31.947515 22732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.941387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:36723 (local address 127.7.113.194:38421)
0806 04:48:31.941650 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:31.941658 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:31.941680 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:48:31.941760 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:31.941766 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:31.941844 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:31.941954 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:31.942391 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.943358 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.945615 (+ 2257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.946687 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.946796 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.946899 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:31.947198 (+ 299us) server_negotiation.cc:299] Negotiation successful
0806 04:48:31.947297 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 04:48:31.947597 22723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.940978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:38421 (local address 127.7.113.195:36723)
0806 04:48:31.941216 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:31.941239 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:31.941363 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:31.941993 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:31.941996 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:31.942023 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:31.942246 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:31.942256 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.943497 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.943503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:31.945453 (+ 1950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:31.945465 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.946832 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.946838 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:31.947031 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.947066 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 04:48:31.947163 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 04:48:31.947296 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"mutex_wait_us":1}
I20260806 04:48:31.948390 22735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.941339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:32777 (local address 127.7.113.193:43845)
0806 04:48:31.941576 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:31.941585 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:31.942127 (+ 542us) server_negotiation.cc:407] Connection header received
0806 04:48:31.942278 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:31.942286 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:31.942389 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:31.942465 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:31.943055 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.943986 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.946397 (+ 2411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.947431 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.947566 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.947647 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:31.948022 (+ 375us) server_negotiation.cc:299] Negotiation successful
0806 04:48:31.948113 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 04:48:31.948491 22746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.941267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43845 (local address 127.7.113.195:32777)
0806 04:48:31.942018 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:31.942034 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:31.942153 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:31.942509 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:31.942513 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:31.942537 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:31.942913 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:31.942924 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.944190 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.944197 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:31.946234 (+ 2037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:31.946249 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.947642 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.947648 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:31.947837 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.947875 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 04:48:31.947980 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 04:48:31.948100 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"mutex_wait_us":58,"thread_start_us":382,"threads_started":1}
I20260806 04:48:31.948774 22543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b8614becc2142dd9f15b7290c011326" candidate_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" is_pre_election: true
I20260806 04:48:31.949321 22543 raft_consensus.cc:2454] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c6f2aa11f744f1b5eb399846e690fa in term 0.
I20260806 04:48:31.949571 22407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b8614becc2142dd9f15b7290c011326" candidate_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97367e709a464999bb6334ba7518a37c" is_pre_election: true
I20260806 04:48:31.949957 22611 leader_election.cc:302] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8c6f2aa11f744f1b5eb399846e690fa, ade63e40c1c44d2c8ac92aa00741daf7; no voters:
I20260806 04:48:31.950114 22407 raft_consensus.cc:2454] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c6f2aa11f744f1b5eb399846e690fa in term 0.
I20260806 04:48:31.950330 22743 raft_consensus.cc:2781] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:48:31.950482 22743 raft_consensus.cc:482] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:48:31.950627 22743 raft_consensus.cc:3037] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:31.952919 22743 raft_consensus.cc:504] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:31.953449 22743 leader_election.cc:288] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [CANDIDATE]: Term 1 election: Requested vote from peers ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421), 97367e709a464999bb6334ba7518a37c (127.7.113.193:43845)
I20260806 04:48:31.953797 22543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b8614becc2142dd9f15b7290c011326" candidate_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade63e40c1c44d2c8ac92aa00741daf7"
I20260806 04:48:31.953884 22407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b8614becc2142dd9f15b7290c011326" candidate_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97367e709a464999bb6334ba7518a37c"
I20260806 04:48:31.954007 22543 raft_consensus.cc:3037] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:31.954102 22407 raft_consensus.cc:3037] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:31.956215 22543 raft_consensus.cc:2454] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c6f2aa11f744f1b5eb399846e690fa in term 1.
I20260806 04:48:31.956225 22407 raft_consensus.cc:2454] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c6f2aa11f744f1b5eb399846e690fa in term 1.
I20260806 04:48:31.956712 22608 leader_election.cc:302] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97367e709a464999bb6334ba7518a37c, a8c6f2aa11f744f1b5eb399846e690fa; no voters:
I20260806 04:48:31.957085 22743 raft_consensus.cc:2781] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:48:31.957481 22743 raft_consensus.cc:686] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [term 1 LEADER]: Becoming Leader. State: Replica: a8c6f2aa11f744f1b5eb399846e690fa, State: Running, Role: LEADER
I20260806 04:48:31.957983 22743 consensus_queue.cc:237] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:31.962409 22265 catalog_manager.cc:5495] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195). New cstate: current_term: 1 leader_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } health_report { overall_health: HEALTHY } } }
W20260806 04:48:31.963502 22455 tablet.cc:2369] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:48:31.998229 22736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:31.993222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53374 (local address 127.7.113.195:43219)
0806 04:48:31.993454 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:31.993458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:31.993479 (+ 21us) server_negotiation.cc:407] Connection header received
0806 04:48:31.993663 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:31.993667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:31.993769 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:31.993951 (+ 182us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:48:31.994258 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.994948 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.996378 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:31.996746 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:31.996832 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:31.997272 (+ 440us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:48:31.997728 (+ 456us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:48:31.997837 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:31.997896 (+ 59us) server_negotiation.cc:299] Negotiation successful
0806 04:48:31.997954 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 04:48:32.005977 22543 raft_consensus.cc:1261] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7 [term 1 FOLLOWER]: Refusing update from remote peer a8c6f2aa11f744f1b5eb399846e690fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:48:32.005977 22407 raft_consensus.cc:1261] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Refusing update from remote peer a8c6f2aa11f744f1b5eb399846e690fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:48:32.006906 22743 consensus_queue.cc:1035] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:48:32.007194 22747 consensus_queue.cc:1035] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:48:32.029317 22266 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:35086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:48:32.029570 22266 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:35086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:48:32.032883 22266 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Sending DeleteTablet for 3 replicas of tablet 3b8614becc2142dd9f15b7290c011326
I20260806 04:48:32.033969 22387 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b8614becc2142dd9f15b7290c011326 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:48:32 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:39448
I20260806 04:48:32.034173 22522 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b8614becc2142dd9f15b7290c011326 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:48:32 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:42896
I20260806 04:48:32.034246 22655 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b8614becc2142dd9f15b7290c011326 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:48:32 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:53358
I20260806 04:48:32.035167 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 22304
I20260806 04:48:32.044917 22760 tablet_replica.cc:330] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa: stopping tablet replica
I20260806 04:48:32.046001 22760 raft_consensus.cc:2229] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:48:32.047343 22760 raft_consensus.cc:2258] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:48:32.050361 22760 ts_tablet_manager.cc:1905] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:48:32.052770 22759 tablet_replica.cc:330] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7: stopping tablet replica
I20260806 04:48:32.052815 22758 tablet_replica.cc:330] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: stopping tablet replica
I20260806 04:48:32.053246 22758 raft_consensus.cc:2229] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:48:32.053278 22759 raft_consensus.cc:2229] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:48:32.053828 22758 raft_consensus.cc:2258] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:48:32.054337 22759 raft_consensus.cc:2258] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:48:32.055898 22758 ts_tablet_manager.cc:1905] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:48:32.056942 22735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:32.036093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39464 (local address 127.7.113.193:43845)
0806 04:48:32.036315 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:32.036324 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:32.036454 (+ 130us) server_negotiation.cc:407] Connection header received
0806 04:48:32.036662 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:32.036670 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:32.036766 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:32.036922 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:32.039129 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:32.040744 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:32.043274 (+ 2530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:32.044181 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:32.044381 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:32.048191 (+ 3810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:32.048211 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:32.048237 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:32.048316 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:32.052345 (+ 4029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:32.053318 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:32.053326 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:32.053330 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:32.053510 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:32.054019 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:32.054026 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:32.054031 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:32.054769 (+ 738us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:32.055048 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:32.056263 (+ 1215us) server_negotiation.cc:299] Negotiation successful
0806 04:48:32.056527 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 04:48:32.058094 22449 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:32.062216 22759 ts_tablet_manager.cc:1905] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:48:32.068181 22759 ts_tablet_manager.cc:1918] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:48:32.068754 22760 ts_tablet_manager.cc:1918] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:48:32.068935 22760 log.cc:1196] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/3b8614becc2142dd9f15b7290c011326
I20260806 04:48:32.069476 22760 ts_tablet_manager.cc:1939] T 3b8614becc2142dd9f15b7290c011326 P a8c6f2aa11f744f1b5eb399846e690fa: Deleting consensus metadata
I20260806 04:48:32.070847 22759 log.cc:1196] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/3b8614becc2142dd9f15b7290c011326
I20260806 04:48:32.071007 22252 catalog_manager.cc:4841] TS a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219): tablet 3b8614becc2142dd9f15b7290c011326 (table test-table [id=6b0d11f6a483442da7c5975fa9960465]) successfully deleted
I20260806 04:48:32.071415 22759 ts_tablet_manager.cc:1939] T 3b8614becc2142dd9f15b7290c011326 P ade63e40c1c44d2c8ac92aa00741daf7: Deleting consensus metadata
I20260806 04:48:32.072844 22253 catalog_manager.cc:4841] TS ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421): tablet 3b8614becc2142dd9f15b7290c011326 (table test-table [id=6b0d11f6a483442da7c5975fa9960465]) successfully deleted
I20260806 04:48:32.173441 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 22304
I20260806 04:48:32.193552 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 22458
W20260806 04:48:32.193946 22250 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.113.193:43845 (error 108)
I20260806 04:48:32.200664 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:32.200214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43845 (local address 127.0.0.1:39474)
0806 04:48:32.200373 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:32.200472 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260806 04:48:32.201258 22250 catalog_manager.cc:4584] TS 97367e709a464999bb6334ba7518a37c (127.7.113.193:43845): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3b8614becc2142dd9f15b7290c011326: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43845: connect: Connection refused (error 111)
I20260806 04:48:32.218221 22732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:32.195149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42900 (local address 127.7.113.194:38421)
0806 04:48:32.195914 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:32.195924 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:32.195946 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:48:32.196022 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:32.196030 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:32.196128 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:32.196290 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:32.199350 (+ 3060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:32.200983 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:32.202957 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:32.203589 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:32.203742 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:32.211179 (+ 7437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:32.211193 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:32.211212 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:32.211258 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:32.215152 (+ 3894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:32.215922 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:32.215932 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:32.215936 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:32.216086 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:32.216538 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:32.216546 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:32.216549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:32.217033 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:32.217331 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:32.217629 (+ 298us) server_negotiation.cc:299] Negotiation successful
0806 04:48:32.217864 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601}
I20260806 04:48:32.218847 22584 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:32.254618 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:32.254200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43845 (local address 127.0.0.1:39488)
0806 04:48:32.254398 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:32.254492 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260806 04:48:32.255662 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:32.255318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43845 (local address 127.0.0.1:39492)
0806 04:48:32.255477 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:32.255545 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 04:48:32.316481 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:32.315888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43845 (local address 127.0.0.1:39504)
0806 04:48:32.316129 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:32.316273 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260806 04:48:32.317706 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:32.317286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43845 (local address 127.0.0.1:39520)
0806 04:48:32.317458 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:32.317556 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260806 04:48:32.341351 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 22458
I20260806 04:48:32.360687 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 22592
I20260806 04:48:32.375527 22736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:32.361648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53388 (local address 127.7.113.195:43219)
0806 04:48:32.361853 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:32.361859 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:32.361879 (+ 20us) server_negotiation.cc:407] Connection header received
0806 04:48:32.362006 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:32.362011 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:32.362111 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:32.362222 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:32.363500 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:32.364552 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:32.365872 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:32.366367 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:32.366500 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:32.369287 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:32.369336 (+ 49us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:32.369355 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:32.369413 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:32.372451 (+ 3038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:32.373164 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:32.373172 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:32.373176 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:32.373337 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:32.373751 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:32.373756 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:32.373760 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:32.374151 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:32.374513 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:32.374785 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 04:48:32.375013 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 04:48:32.376508 22716 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:32.398430 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:32.397931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43845 (local address 127.0.0.1:39530)
0806 04:48:32.398139 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:32.398242 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260806 04:48:32.399493 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:32.399057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43845 (local address 127.0.0.1:39536)
0806 04:48:32.399282 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:32.399366 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260806 04:48:32.497835 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 22592
I20260806 04:48:32.519395 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 22233
I20260806 04:48:32.520648 22297 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:32.632037 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:32.631124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43845 (local address 127.0.0.1:39538)
0806 04:48:32.631627 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:32.631753 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317}
I20260806 04:48:32.632335 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 22233
I20260806 04:48:32.656208 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:38423
--webserver_interface=127.7.113.254
--webserver_port=44321
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:38423
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:32.984961 22766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:32.985281 22766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:32.985435 22766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:32.992430 22766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:48:32.992576 22766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:32.992683 22766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:32.992789 22766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:48:32.992877 22766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:48:33.001890 22766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:38423
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:38423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=44321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:33.003189 22766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:33.004452 22766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:33.015697 22772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:33.015951 22774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:33.015964 22771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:33.016824 22766 server_base.cc:1034] running on GCE node
I20260806 04:48:33.017558 22766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:33.018811 22766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:33.020037 22766 hybrid_clock.cc:648] HybridClock initialized: now 1785991713019991 us; error 53 us; skew 500 ppm
I20260806 04:48:33.020438 22766 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:33 dist-test-slave-0b58 krb5kdc[21667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991713, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:33.023463 22766 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:48:33.024854 22766 webserver.cc:460] Webserver started at http://127.7.113.254:44321/ using document root <none> and password file <none>
I20260806 04:48:33.025446 22766 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:33.025544 22766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:33.030517 22766 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 04:48:33.033277 22781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:33.034485 22766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:48:33.034614 22766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "547a882df57f4b118b75e5da3a11e9e0"
format_stamp: "Formatted at 2026-08-06 04:48:27 on dist-test-slave-0b58"
server_key: "134ec814ee3c98ef9032da6934b0a928"
server_key_iv: "47d09e0bea721e074e82a62ee6080790"
server_key_version: "encryptionkey@0"
I20260806 04:48:33.035522 22766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:33.060156 22766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:33.064410 22766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:33.064601 22766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:33.083014 22766 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:38423
I20260806 04:48:33.083043 22832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:38423 every 8 connection(s)
I20260806 04:48:33.084487 22766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:48:33.091253 22833 sys_catalog.cc:263] Verifying existing consensus state
I20260806 04:48:33.093171 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 22766
I20260806 04:48:33.094121 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:43845
--local_ip_for_outbound_sockets=127.7.113.193
--tserver_master_addrs=127.7.113.254:38423
--webserver_port=36355
--webserver_interface=127.7.113.193
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:48:33.095381 22833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Bootstrap starting.
I20260806 04:48:33.118863 22833 log.cc:824] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:33.134994 22833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 04:48:33.135573 22833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0: Bootstrap complete.
I20260806 04:48:33.146538 22833 raft_consensus.cc:348] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } }
I20260806 04:48:33.147505 22833 raft_consensus.cc:729] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 547a882df57f4b118b75e5da3a11e9e0, State: Initialized, Role: FOLLOWER
I20260806 04:48:33.148090 22833 consensus_queue.cc:260] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } }
I20260806 04:48:33.148337 22833 raft_consensus.cc:388] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:48:33.148463 22833 raft_consensus.cc:482] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:48:33.148650 22833 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 2 FOLLOWER]: Advancing to term 3
I20260806 04:48:33.152473 22833 raft_consensus.cc:504] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } }
I20260806 04:48:33.152967 22833 leader_election.cc:302] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 547a882df57f4b118b75e5da3a11e9e0; no voters:
I20260806 04:48:33.153715 22833 leader_election.cc:288] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 04:48:33.153860 22837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 04:48:33.155000 22837 raft_consensus.cc:686] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [term 3 LEADER]: Becoming Leader. State: Replica: 547a882df57f4b118b75e5da3a11e9e0, State: Running, Role: LEADER
I20260806 04:48:33.155557 22837 consensus_queue.cc:237] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } }
I20260806 04:48:33.155993 22833 sys_catalog.cc:564] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:48:33.158274 22839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 547a882df57f4b118b75e5da3a11e9e0. Latest consensus state: current_term: 3 leader_uuid: "547a882df57f4b118b75e5da3a11e9e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } } }
I20260806 04:48:33.158696 22839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:33.159435 22838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "547a882df57f4b118b75e5da3a11e9e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547a882df57f4b118b75e5da3a11e9e0" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 38423 } } }
I20260806 04:48:33.159777 22838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 547a882df57f4b118b75e5da3a11e9e0 [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:33.163507 22844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:48:33.173723 22844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:48:33.175318 22844 catalog_manager.cc:1259] Loaded cluster ID: ae16232fc6454b549a96345a7a1ce1f3
I20260806 04:48:33.175475 22844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260806 04:48:33.177814 22844 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2b1f87a9ad google::LogMessage::Fail() at ??:0
@ 0x7f2b1f87d88a google::LogMessage::SendToLog() at ??:0
@ 0x7f2b1f87a4de google::LogMessage::Flush() at ??:0
@ 0x7f2b1f87ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2b352ad512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f2b352aa976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2b35332610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f2b35332439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f2b224c6345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2b224c991c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f2b224c9799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f2b224a4eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2b2577e6db start_thread at ??:0
@ 0x7f2b1e71461f clone at ??:0
W20260806 04:48:33.495250 22835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:33.495510 22835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:33.495620 22835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:33.502737 22835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:33.502859 22835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:33.503073 22835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:48:33.512682 22835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:43845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=36355
--tserver_master_addrs=127.7.113.254:38423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:33.513981 22835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:33.515313 22835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:33.528033 22879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:33.528101 22876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:33.528075 22877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:33.529265 22835 server_base.cc:1034] running on GCE node
I20260806 04:48:33.529876 22835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:33.530874 22835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:33.532100 22835 hybrid_clock.cc:648] HybridClock initialized: now 1785991713532054 us; error 56 us; skew 500 ppm
I20260806 04:48:33.532471 22835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:33 dist-test-slave-0b58 krb5kdc[21667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991713, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:33.535601 22835 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:48:33.537094 22835 webserver.cc:460] Webserver started at http://127.7.113.193:36355/ using document root <none> and password file <none>
I20260806 04:48:33.537722 22835 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:33.537822 22835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:33.542867 22835 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 04:48:33.547792 22886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:33.549090 22835 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:48:33.549212 22835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "97367e709a464999bb6334ba7518a37c"
format_stamp: "Formatted at 2026-08-06 04:48:27 on dist-test-slave-0b58"
server_key: "bce963b592c513dd21b67843731e0e8d"
server_key_iv: "bddf3c51c3c0e1c4435f457d97742daf"
server_key_version: "encryptionkey@0"
I20260806 04:48:33.550120 22835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:33.567108 22835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:33.571260 22835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:33.571484 22835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:33.572424 22835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:33.574357 22893 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260806 04:48:33.579599 22835 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 04:48:33.579694 22835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260806 04:48:33.579782 22835 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 04:48:33.582808 22835 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 04:48:33.582894 22835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20260806 04:48:33.583220 22893 tablet_bootstrap.cc:492] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: Bootstrap starting.
I20260806 04:48:33.591529 22893 log.cc:824] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:33.604053 22893 tablet_bootstrap.cc:492] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 04:48:33.604873 22893 tablet_bootstrap.cc:492] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: Bootstrap complete.
I20260806 04:48:33.605369 22893 ts_tablet_manager.cc:1397] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: Time spent bootstrapping tablet: real 0.022s user 0.021s sys 0.000s
I20260806 04:48:33.616292 22893 raft_consensus.cc:348] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:33.617775 22893 raft_consensus.cc:729] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97367e709a464999bb6334ba7518a37c, State: Initialized, Role: FOLLOWER
I20260806 04:48:33.618510 22893 consensus_queue.cc:260] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:33.620229 22893 ts_tablet_manager.cc:1428] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c: Time spent starting tablet: real 0.015s user 0.006s sys 0.008s
I20260806 04:48:33.626961 22835 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:43845
I20260806 04:48:33.627051 23002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:43845 every 8 connection(s)
I20260806 04:48:33.628188 22835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:48:33.632486 23005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:33.630664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:49477)
0806 04:48:33.631388 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:33.631599 (+ 211us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":305,"threads_started":1}
W20260806 04:48:33.633061 23003 heartbeater.cc:644] Failed to heartbeat to 127.7.113.254:38423 (0 consecutive failures): Network error: Failed to ping master at 127.7.113.254:38423: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
I20260806 04:48:33.633802 23005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:33.633523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:52455)
0806 04:48:33.633645 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:33.633708 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 04:48:33.634645 23005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:33.634326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:39439)
0806 04:48:33.634473 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:33.634539 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260806 04:48:33.634934 23003 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 04:48:33.635264 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 22835
I20260806 04:48:33.635856 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:38421
--local_ip_for_outbound_sockets=127.7.113.194
--tserver_master_addrs=127.7.113.254:38423
--webserver_port=44285
--webserver_interface=127.7.113.194
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:33.965317 23006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:33.965570 23006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:33.965660 23006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:33.972819 23006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:33.972918 23006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:33.973035 23006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:48:33.982497 23006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:38421
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=44285
--tserver_master_addrs=127.7.113.254:38423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:33.983839 23006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:33.985116 23006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:33.997718 23011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:33.997792 23014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:33.997826 23012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:33.998867 23006 server_base.cc:1034] running on GCE node
I20260806 04:48:33.999409 23006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:34.000344 23006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:34.001567 23006 hybrid_clock.cc:648] HybridClock initialized: now 1785991714001511 us; error 45 us; skew 500 ppm
I20260806 04:48:34.001899 23006 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:34 dist-test-slave-0b58 krb5kdc[21667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991713, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:34.004971 23006 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:48:34.006505 23006 webserver.cc:460] Webserver started at http://127.7.113.194:44285/ using document root <none> and password file <none>
I20260806 04:48:34.007181 23006 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:34.007324 23006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:34.012357 23006 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 04:48:34.014819 23021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:34.016043 23006 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 04:48:34.016219 23006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "ade63e40c1c44d2c8ac92aa00741daf7"
format_stamp: "Formatted at 2026-08-06 04:48:28 on dist-test-slave-0b58"
server_key: "26aa5f807c60c59641d992dff8c5f787"
server_key_iv: "1246258b6619252a8ff664ab3d835ff4"
server_key_version: "encryptionkey@0"
I20260806 04:48:34.017244 23006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:34.027758 23006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:34.031219 23006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:34.031481 23006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:34.032409 23006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:34.033582 23006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:34.033721 23006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:34.033846 23006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:34.033933 23006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:34.066938 23006 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:38421
I20260806 04:48:34.067023 23135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:38421 every 8 connection(s)
I20260806 04:48:34.068591 23006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:48:34.072436 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 23006
I20260806 04:48:34.073074 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:43219
--local_ip_for_outbound_sockets=127.7.113.195
--tserver_master_addrs=127.7.113.254:38423
--webserver_port=41687
--webserver_interface=127.7.113.195
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:48:34.073421 23138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:34.071352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:51275)
0806 04:48:34.072104 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:34.072413 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":305,"threads_started":1}
W20260806 04:48:34.074134 23136 heartbeater.cc:644] Failed to heartbeat to 127.7.113.254:38423 (0 consecutive failures): Network error: Failed to ping master at 127.7.113.254:38423: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
I20260806 04:48:34.074940 23138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:34.074658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:39629)
0806 04:48:34.074786 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:34.074845 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 04:48:34.075734 23138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:34.075465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:34409)
0806 04:48:34.075577 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:34.075641 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 04:48:34.076001 23136 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 04:48:34.396351 23139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:34.396584 23139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:34.396736 23139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:34.403656 23139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:34.403752 23139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:34.403906 23139 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:48:34.413430 23139 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:43219
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=41687
--tserver_master_addrs=127.7.113.254:38423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:34.414642 23139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:34.415885 23139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:34.428728 23144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:34.428766 23145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:34.429106 23147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:34.429939 23139 server_base.cc:1034] running on GCE node
I20260806 04:48:34.430523 23139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:34.431453 23139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:34.432668 23139 hybrid_clock.cc:648] HybridClock initialized: now 1785991714432628 us; error 53 us; skew 500 ppm
I20260806 04:48:34.432967 23139 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:34 dist-test-slave-0b58 krb5kdc[21667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991714, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:34.435961 23139 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:48:34.437263 23139 webserver.cc:460] Webserver started at http://127.7.113.195:41687/ using document root <none> and password file <none>
I20260806 04:48:34.437873 23139 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:34.437971 23139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:34.442824 23139 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.005s
I20260806 04:48:34.445256 23154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:34.446482 23139 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 04:48:34.446643 23139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "a8c6f2aa11f744f1b5eb399846e690fa"
format_stamp: "Formatted at 2026-08-06 04:48:28 on dist-test-slave-0b58"
server_key: "5c1b7a3f851623b68274fc59c70f6097"
server_key_iv: "e5927006b4d03b161e533e8675d8178c"
server_key_version: "encryptionkey@0"
I20260806 04:48:34.447566 23139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:34.478412 23139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:34.482623 23139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:34.482903 23139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:34.483871 23139 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:34.485167 23139 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:34.485287 23139 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:34.485415 23139 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:34.485512 23139 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:34.517910 23139 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:43219
I20260806 04:48:34.517997 23269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:43219 every 8 connection(s)
I20260806 04:48:34.519322 23139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:48:34.520473 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 23139
I20260806 04:48:34.524466 23273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:34.522652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:33137)
0806 04:48:34.523323 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:34.523546 (+ 223us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":263,"threads_started":1}
W20260806 04:48:34.525100 23270 heartbeater.cc:644] Failed to heartbeat to 127.7.113.254:38423 (0 consecutive failures): Network error: Failed to ping master at 127.7.113.254:38423: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
I20260806 04:48:34.525897 23273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:34.525564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:34221)
0806 04:48:34.525721 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:34.525800 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 04:48:34.526665 23273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:34.526361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:55505)
0806 04:48:34.526489 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:34.526566 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 04:48:34.526891 23270 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 04:48:34.636188 23274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:34.635462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:41159)
0806 04:48:34.635903 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:34.635991 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":235,"threads_started":1}
I20260806 04:48:35.075675 23275 raft_consensus.cc:482] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:48:35.075902 23275 raft_consensus.cc:504] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:35.077307 23276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:35.076557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:55017)
0806 04:48:35.076985 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:35.077061 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":217,"threads_started":1}
I20260806 04:48:35.077685 23275 leader_election.cc:288] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421), a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219)
Aug 06 04:48:35 dist-test-slave-0b58 krb5kdc[21667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991713, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
Aug 06 04:48:35 dist-test-slave-0b58 krb5kdc[21667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991713, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:48:35.099298 23279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:35.078256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:52387 (local address 127.7.113.194:38421)
0806 04:48:35.080027 (+ 1771us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:35.080038 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:35.080071 (+ 33us) server_negotiation.cc:407] Connection header received
0806 04:48:35.081992 (+ 1921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:35.082001 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:35.082356 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:35.082698 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:35.084693 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:35.085887 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:35.087635 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:35.088228 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:35.088444 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:35.092468 (+ 4024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:35.092485 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:35.092519 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:35.092563 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:35.095567 (+ 3004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:35.096467 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:35.096475 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:35.096482 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:35.096642 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:35.097084 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:35.097092 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:35.097096 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:35.097547 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:35.097727 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:35.098562 (+ 835us) server_negotiation.cc:299] Negotiation successful
0806 04:48:35.098918 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1605,"thread_start_us":1438,"threads_started":1}
I20260806 04:48:35.099308 23277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:35.078019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:43219 (local address 127.7.113.193:46833)
0806 04:48:35.079643 (+ 1624us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:35.079702 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:35.079828 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:35.082816 (+ 2988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:35.082829 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:35.083588 (+ 759us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:35.084511 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:35.084531 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:35.086091 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:35.086094 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:35.087483 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:35.087495 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:35.088487 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:35.088494 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:35.088702 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:35.089553 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:35.089570 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:35.092455 (+ 2885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:35.095829 (+ 3374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:35.095833 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:35.095835 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:35.096372 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:35.096828 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:35.096831 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:35.096836 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:35.096991 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:35.097703 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:35.097711 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:35.098050 (+ 339us) client_negotiation.cc:769] Sending connection context
0806 04:48:35.098330 (+ 280us) client_negotiation.cc:240] Negotiation successful
0806 04:48:35.098818 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1459,"mutex_wait_us":150,"spinlock_wait_cycles":39808,"thread_start_us":1317,"threads_started":1}
I20260806 04:48:35.099362 23278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:35.078222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:46833 (local address 127.7.113.195:43219)
0806 04:48:35.080345 (+ 2123us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:35.080360 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:35.080399 (+ 39us) server_negotiation.cc:407] Connection header received
0806 04:48:35.082109 (+ 1710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:35.082117 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:35.082430 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:35.082722 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:35.084727 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:35.085902 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:35.087624 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:35.088232 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:35.088491 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:35.092727 (+ 4236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:35.092734 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:35.092744 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:35.092777 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:35.095674 (+ 2897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:35.096507 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:35.096512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:35.096518 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:35.096679 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:35.097131 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:35.097135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:35.097137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:35.097546 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:35.097747 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:35.098571 (+ 824us) server_negotiation.cc:299] Negotiation successful
0806 04:48:35.098925 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1904,"thread_start_us":1819,"threads_started":1}
I20260806 04:48:35.099390 23274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:35.077916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:38421 (local address 127.7.113.193:52387)
0806 04:48:35.078182 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:35.078227 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:35.078851 (+ 624us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:35.082815 (+ 3964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:35.082827 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:35.083586 (+ 759us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:35.084511 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:35.084532 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:35.086083 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:35.086087 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:35.087481 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:35.087493 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:35.088439 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:35.088446 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:35.088699 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:35.089498 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:35.089520 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:35.092096 (+ 2576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:35.095731 (+ 3635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:35.095740 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:35.095754 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:35.096347 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:35.096784 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:35.096790 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:35.096793 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:35.096976 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:35.097705 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:35.097710 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:35.098061 (+ 351us) client_negotiation.cc:769] Sending connection context
0806 04:48:35.098334 (+ 273us) client_negotiation.cc:240] Negotiation successful
0806 04:48:35.098984 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":453,"spinlock_wait_cycles":13568}
W20260806 04:48:35.102595 22890 leader_election.cc:341] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421): Not found: Tablet not found: 3b8614becc2142dd9f15b7290c011326
W20260806 04:48:35.102869 22889 leader_election.cc:341] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219): Not found: Tablet not found: 3b8614becc2142dd9f15b7290c011326
I20260806 04:48:35.103053 22889 leader_election.cc:302] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97367e709a464999bb6334ba7518a37c; no voters: a8c6f2aa11f744f1b5eb399846e690fa, ade63e40c1c44d2c8ac92aa00741daf7
I20260806 04:48:35.103503 23275 raft_consensus.cc:2726] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 04:48:35.528182 23280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:35.527343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:41965)
0806 04:48:35.527794 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:35.527944 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":216,"threads_started":1}
I20260806 04:48:35.638245 23281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:35.637155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:38263)
0806 04:48:35.637888 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:35.637994 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":442,"threads_started":1}
I20260806 04:48:36.078806 23282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:36.078092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:37067)
0806 04:48:36.078577 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:36.078652 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":296,"threads_started":1}
I20260806 04:48:36.529698 23283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:36.529018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:37821)
0806 04:48:36.529451 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:36.529560 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":209,"threads_started":1}
I20260806 04:48:36.639909 23284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:36.639238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:38127)
0806 04:48:36.639645 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:36.639719 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":208,"threads_started":1}
I20260806 04:48:36.923738 23285 raft_consensus.cc:482] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:48:36.923974 23285 raft_consensus.cc:504] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:36.924641 23285 leader_election.cc:288] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421), a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219)
W20260806 04:48:36.925729 22889 leader_election.cc:341] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219): Not found: Tablet not found: 3b8614becc2142dd9f15b7290c011326
W20260806 04:48:36.925940 22890 leader_election.cc:341] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421): Not found: Tablet not found: 3b8614becc2142dd9f15b7290c011326
I20260806 04:48:36.926102 22890 leader_election.cc:302] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97367e709a464999bb6334ba7518a37c; no voters: a8c6f2aa11f744f1b5eb399846e690fa, ade63e40c1c44d2c8ac92aa00741daf7
I20260806 04:48:36.926438 23285 raft_consensus.cc:2726] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 04:48:37.080196 23286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:37.079557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:35817)
0806 04:48:37.079966 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:37.080041 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":214,"threads_started":1}
I20260806 04:48:37.531424 23287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:37.530733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:57611)
0806 04:48:37.531188 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:37.531264 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":255,"threads_started":1}
I20260806 04:48:37.641448 23288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:37.640812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:36989)
0806 04:48:37.641207 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:37.641291 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":220,"threads_started":1}
I20260806 04:48:38.081670 23289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:38.081015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:45095)
0806 04:48:38.081419 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:38.081497 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":195,"threads_started":1}
I20260806 04:48:38.533212 23290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:38.532327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:57973)
0806 04:48:38.532794 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:38.532922 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":221,"threads_started":1}
I20260806 04:48:38.643123 23291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:38.642429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:57873)
0806 04:48:38.642858 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:38.642950 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":203,"threads_started":1}
I20260806 04:48:39.083178 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:39.082492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:44459)
0806 04:48:39.082946 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:39.083023 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":246,"threads_started":1}
I20260806 04:48:39.161649 23293 raft_consensus.cc:482] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:48:39.161871 23293 raft_consensus.cc:504] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:39.162891 23293 leader_election.cc:288] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421), a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219)
W20260806 04:48:39.163574 22890 leader_election.cc:341] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421): Not found: Tablet not found: 3b8614becc2142dd9f15b7290c011326
W20260806 04:48:39.163762 22889 leader_election.cc:341] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219): Not found: Tablet not found: 3b8614becc2142dd9f15b7290c011326
I20260806 04:48:39.163899 22889 leader_election.cc:302] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97367e709a464999bb6334ba7518a37c; no voters: a8c6f2aa11f744f1b5eb399846e690fa, ade63e40c1c44d2c8ac92aa00741daf7
I20260806 04:48:39.164134 23293 raft_consensus.cc:2726] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 04:48:39.534741 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:39.534107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:49271)
0806 04:48:39.534515 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:39.534590 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":225,"threads_started":1}
I20260806 04:48:39.644975 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:39.644132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:58567)
0806 04:48:39.644669 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:39.644778 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":306,"threads_started":1}
I20260806 04:48:40.085460 23296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:40.084233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:46025)
0806 04:48:40.085172 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:40.085267 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":827,"thread_start_us":644,"threads_started":1}
I20260806 04:48:40.536576 23297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:40.535777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:48097)
0806 04:48:40.536239 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:40.536390 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":249,"threads_started":1}
I20260806 04:48:40.646521 23298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:40.645772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:46227)
0806 04:48:40.646263 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:40.646343 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":268,"threads_started":1}
I20260806 04:48:41.087363 23299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:41.086495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:53703)
0806 04:48:41.087066 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:41.087179 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":277,"threads_started":1}
I20260806 04:48:41.538309 23300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:41.537393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:53687)
0806 04:48:41.538045 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:41.538135 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":374,"threads_started":1}
I20260806 04:48:41.648025 23301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:41.647365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:38461)
0806 04:48:41.647782 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:41.647870 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":207,"threads_started":1}
I20260806 04:48:41.942621 23302 raft_consensus.cc:482] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:48:41.942831 23302 raft_consensus.cc:504] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:41.943516 23302 leader_election.cc:288] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421), a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219)
W20260806 04:48:41.944458 22890 leader_election.cc:341] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421): Not found: Tablet not found: 3b8614becc2142dd9f15b7290c011326
W20260806 04:48:41.944641 22889 leader_election.cc:341] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219): Not found: Tablet not found: 3b8614becc2142dd9f15b7290c011326
I20260806 04:48:41.944758 22889 leader_election.cc:302] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97367e709a464999bb6334ba7518a37c; no voters: a8c6f2aa11f744f1b5eb399846e690fa, ade63e40c1c44d2c8ac92aa00741daf7
I20260806 04:48:41.944991 23302 raft_consensus.cc:2726] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 04:48:42.089334 23303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:42.088414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:37113)
0806 04:48:42.088978 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:42.089089 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":233,"threads_started":1}
I20260806 04:48:42.539961 23304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:42.539239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:50203)
0806 04:48:42.539705 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:42.539782 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":262,"threads_started":1}
I20260806 04:48:42.649590 23305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:42.648940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:43409)
0806 04:48:42.649352 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:42.649434 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":216,"threads_started":1}
I20260806 04:48:43.091039 23306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:43.090224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:38319)
0806 04:48:43.090787 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:43.090872 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":308,"threads_started":1}
I20260806 04:48:43.541436 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:43.540769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:45241)
0806 04:48:43.541186 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:43.541275 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":210,"threads_started":1}
I20260806 04:48:43.571853 23308 raft_consensus.cc:482] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:48:43.572033 23308 raft_consensus.cc:504] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade63e40c1c44d2c8ac92aa00741daf7" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38421 } } peers { permanent_uuid: "97367e709a464999bb6334ba7518a37c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43845 } } peers { permanent_uuid: "a8c6f2aa11f744f1b5eb399846e690fa" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43219 } }
I20260806 04:48:43.572655 23308 leader_election.cc:288] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421), a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219)
W20260806 04:48:43.573536 22889 leader_election.cc:341] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c6f2aa11f744f1b5eb399846e690fa (127.7.113.195:43219): Not found: Tablet not found: 3b8614becc2142dd9f15b7290c011326
W20260806 04:48:43.573747 22890 leader_election.cc:341] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ade63e40c1c44d2c8ac92aa00741daf7 (127.7.113.194:38421): Not found: Tablet not found: 3b8614becc2142dd9f15b7290c011326
I20260806 04:48:43.573907 22890 leader_election.cc:302] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97367e709a464999bb6334ba7518a37c; no voters: a8c6f2aa11f744f1b5eb399846e690fa, ade63e40c1c44d2c8ac92aa00741daf7
I20260806 04:48:43.574162 23308 raft_consensus.cc:2726] T 3b8614becc2142dd9f15b7290c011326 P 97367e709a464999bb6334ba7518a37c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 04:48:43.651327 23309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:43.650576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:45281)
0806 04:48:43.651018 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:43.651112 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":212,"threads_started":1}
I20260806 04:48:44.092674 23310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:44.091908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:60881)
0806 04:48:44.092426 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:44.092507 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":236,"threads_started":1}
I20260806 04:48:44.542963 23311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:44.542295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:46489)
0806 04:48:44.542714 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:44.542788 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":228,"threads_started":1}
I20260806 04:48:44.652866 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:44.652146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:50073)
0806 04:48:44.652621 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:44.652703 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":285,"threads_started":1}
I20260806 04:48:45.094153 23313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:45.093453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:35963)
0806 04:48:45.093906 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:45.093983 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":241,"threads_started":1}
I20260806 04:48:45.544751 23314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:45.543962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:48165)
0806 04:48:45.544510 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:45.544593 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":335,"threads_started":1}
I20260806 04:48:45.654312 23315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:45.653687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:46749)
0806 04:48:45.654081 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:45.654157 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":209,"threads_started":1}
I20260806 04:48:46.095713 23316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:46.095027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:44643)
0806 04:48:46.095467 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:46.095553 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":245,"threads_started":1}
I20260806 04:48:46.546285 23317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:46.545572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:40335)
0806 04:48:46.546025 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:46.546105 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":234,"threads_started":1}
I20260806 04:48:46.655747 23318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:46.655071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:48507)
0806 04:48:46.655483 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:46.655566 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":219,"threads_started":1}
I20260806 04:48:47.097380 23319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:47.096721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:45827)
0806 04:48:47.097132 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:47.097229 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":217,"threads_started":1}
I20260806 04:48:47.547997 23320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:47.547199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:34585)
0806 04:48:47.547709 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:47.547796 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":271,"threads_started":1}
I20260806 04:48:47.657371 23321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:47.656613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:33095)
0806 04:48:47.657109 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:47.657192 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":261,"threads_started":1}
I20260806 04:48:48.098914 23322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:48.098231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:44629)
0806 04:48:48.098651 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:48.098727 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":215,"threads_started":1}
I20260806 04:48:48.549619 23324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:48.548885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:35109)
0806 04:48:48.549346 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:48.549426 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":222,"threads_started":1}
I20260806 04:48:48.659089 23325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:48.658380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.193:33235)
0806 04:48:48.658830 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:48.658919 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":203,"threads_started":1}
I20260806 04:48:49.100903 23326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:49.100052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.194:54791)
0806 04:48:49.100649 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:49.100733 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":295,"threads_started":1}
I20260806 04:48:49.526561 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 22835
I20260806 04:48:49.541555 23327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:49.527586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47578 (local address 127.7.113.193:43845)
0806 04:48:49.528172 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:49.528185 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:49.528223 (+ 38us) server_negotiation.cc:407] Connection header received
0806 04:48:49.528328 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:49.528340 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:49.528646 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:49.528825 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:49.530801 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:49.531800 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:49.533116 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:49.533635 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:49.533727 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:49.536333 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:49.536349 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:49.536362 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:49.536392 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:49.539233 (+ 2841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:49.539843 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:49.539851 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:49.539853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:49.539976 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:49.540329 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:49.540337 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:49.540339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:49.540658 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:49.540874 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:49.541087 (+ 213us) server_negotiation.cc:299] Negotiation successful
0806 04:48:49.541279 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":236,"threads_started":1}
I20260806 04:48:49.542760 22998 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:49.551393 23329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:49.550604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:38423 (local address 127.7.113.195:43391)
0806 04:48:49.551115 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:49.551243 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":265,"threads_started":1}
I20260806 04:48:49.632189 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 22835
I20260806 04:48:49.652249 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 23006
I20260806 04:48:49.665957 23330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:49.653131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35832 (local address 127.7.113.194:38421)
0806 04:48:49.653601 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:49.653605 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:49.653622 (+ 17us) server_negotiation.cc:407] Connection header received
0806 04:48:49.653685 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:49.653688 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:49.653750 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:49.653839 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:49.655240 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:49.656172 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:49.657522 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:49.657939 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:49.658035 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:49.660827 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:49.660832 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:49.660836 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:49.660868 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:49.663384 (+ 2516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:49.664049 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:49.664053 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:49.664055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:49.664188 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:49.664677 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:49.664681 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:49.664683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:49.664945 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:49.665137 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:49.665388 (+ 251us) server_negotiation.cc:299] Negotiation successful
0806 04:48:49.665553 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":265,"threads_started":1}
I20260806 04:48:49.666651 23131 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:49.750281 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 23006
I20260806 04:48:49.770296 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 23139
I20260806 04:48:49.784638 23332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:49.771174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34476 (local address 127.7.113.195:43219)
0806 04:48:49.771815 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:49.771819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:49.771836 (+ 17us) server_negotiation.cc:407] Connection header received
0806 04:48:49.771893 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:49.771896 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:49.771955 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:49.772082 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:49.773622 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:49.774431 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:49.775699 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:49.776133 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:49.776344 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:49.779052 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:49.779057 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:49.779061 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:49.779093 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:49.781785 (+ 2692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:49.782541 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:49.782546 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:49.782556 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:49.782709 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:49.783114 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:49.783120 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:49.783123 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:49.783409 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:49.783708 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:49.783993 (+ 285us) server_negotiation.cc:299] Negotiation successful
0806 04:48:49.784233 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":342,"threads_started":1}
I20260806 04:48:49.785502 23265 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:49.869485 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 23139
2026-08-06T04:48:49Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24378 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:48:49 dist-test-slave-0b58 krb5kdc[23336](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:48:49 dist-test-slave-0b58 krb5kdc[23336](info): set up 2 sockets
Aug 06 04:48:49 dist-test-slave-0b58 krb5kdc[23336](info): commencing operation
krb5kdc: starting...
W20260806 04:48:50.982903 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.001s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:48:51 dist-test-slave-0b58 krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:48:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:48:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:48:51.245049 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42335
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:42335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:51.571843 23349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:51.572178 23349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:51.572365 23349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:51.579541 23349 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 04:48:51.579674 23349 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 04:48:51.579766 23349 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 04:48:51.579847 23349 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:48:51.579928 23349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:51.580032 23349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:51.580118 23349 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:48:51.580199 23349 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:48:51.589846 23349 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:42335
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:51.591130 23349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:51.592417 23349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:51.604207 23354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:51.604326 23357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:51.604275 23355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:51.605100 23349 server_base.cc:1034] running on GCE node
I20260806 04:48:51.605861 23349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:51.607141 23349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:51.608371 23349 hybrid_clock.cc:648] HybridClock initialized: now 1785991731608306 us; error 33 us; skew 500 ppm
I20260806 04:48:51.608704 23349 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:51 dist-test-slave-0b58 krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991731, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:51.611714 23349 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:48:51.613112 23349 webserver.cc:460] Webserver started at http://127.7.113.254:38033/ using document root <none> and password file <none>
I20260806 04:48:51.613705 23349 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:51.613787 23349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:51.614041 23349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:48:51.616920 23349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "59c440f4b7cf4328a241e648c803b3fe"
format_stamp: "Formatted at 2026-08-06 04:48:51 on dist-test-slave-0b58"
server_key: "b608a369d5a95f480508b824774c90ce"
server_key_iv: "19177ab49d71e4f6fb11e258e429cf2f"
server_key_version: "encryptionkey@0"
I20260806 04:48:51.617627 23349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "59c440f4b7cf4328a241e648c803b3fe"
format_stamp: "Formatted at 2026-08-06 04:48:51 on dist-test-slave-0b58"
server_key: "b608a369d5a95f480508b824774c90ce"
server_key_iv: "19177ab49d71e4f6fb11e258e429cf2f"
server_key_version: "encryptionkey@0"
I20260806 04:48:51.622530 23349 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:48:51.625771 23364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:51.626991 23349 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 04:48:51.627166 23349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "59c440f4b7cf4328a241e648c803b3fe"
format_stamp: "Formatted at 2026-08-06 04:48:51 on dist-test-slave-0b58"
server_key: "b608a369d5a95f480508b824774c90ce"
server_key_iv: "19177ab49d71e4f6fb11e258e429cf2f"
server_key_version: "encryptionkey@0"
I20260806 04:48:51.627345 23349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:51.649957 23349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:51.653817 23349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:51.654094 23349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:51.673101 23349 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:42335
I20260806 04:48:51.673125 23415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:42335 every 8 connection(s)
I20260806 04:48:51.674373 23349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:48:51.677424 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 23349
I20260806 04:48:51.677644 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:48:51.678367 23416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:51.678511 7623 external_mini_cluster.cc:1428] Setting key 9c228943ff8375622f22920e5d66bae4
I20260806 04:48:51.693418 23416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Bootstrap starting.
Aug 06 04:48:51 dist-test-slave-0b58 krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:51.697229 23416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:51.698591 23416 log.cc:824] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:51.702039 23416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: No bootstrap required, opened a new log
I20260806 04:48:51.703683 23419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:51.680589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43684 (local address 127.7.113.254:42335)
0806 04:48:51.681399 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:51.681413 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:51.681456 (+ 43us) server_negotiation.cc:407] Connection header received
0806 04:48:51.683139 (+ 1683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:51.683159 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:51.683523 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:51.683864 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:51.685877 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:51.687192 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:51.689175 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:51.689860 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:51.689997 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:51.694936 (+ 4939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:51.694950 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:51.694970 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:51.695030 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:51.699008 (+ 3978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:51.699886 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:51.699892 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:51.699897 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:51.700131 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:51.700559 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:51.700564 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:51.700566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:51.701201 (+ 635us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:51.701495 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:51.701857 (+ 362us) server_negotiation.cc:299] Negotiation successful
0806 04:48:51.702313 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":377,"threads_started":1}
I20260806 04:48:51.710909 23416 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } }
I20260806 04:48:51.711239 23416 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:51.711313 23416 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59c440f4b7cf4328a241e648c803b3fe, State: Initialized, Role: FOLLOWER
I20260806 04:48:51.711866 23416 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } }
I20260806 04:48:51.712095 23416 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:48:51.712304 23416 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:48:51.712534 23416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:51.714859 23416 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } }
I20260806 04:48:51.715296 23416 leader_election.cc:302] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59c440f4b7cf4328a241e648c803b3fe; no voters:
I20260806 04:48:51.715847 23416 leader_election.cc:288] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:48:51.716019 23421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:48:51.716704 23421 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 1 LEADER]: Becoming Leader. State: Replica: 59c440f4b7cf4328a241e648c803b3fe, State: Running, Role: LEADER
I20260806 04:48:51.717355 23421 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } }
I20260806 04:48:51.718021 23416 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:48:51.720283 23422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59c440f4b7cf4328a241e648c803b3fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } } }
I20260806 04:48:51.720703 23422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:51.721050 23423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59c440f4b7cf4328a241e648c803b3fe. Latest consensus state: current_term: 1 leader_uuid: "59c440f4b7cf4328a241e648c803b3fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } } }
I20260806 04:48:51.721576 23423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: This master's current role is: LEADER
I20260806 04:48:51.724020 23427 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:48:51.729665 23427 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:48:51.738435 23427 catalog_manager.cc:1347] Generated new cluster ID: 152d0872dbac444b9355a655d959ec72
I20260806 04:48:51.738567 23427 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:48:51.754534 23427 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:48:51.755869 23427 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:48:51.767498 23427 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Generated new TSK 0
I20260806 04:48:51.768386 23427 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:48:51.847744 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42335
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:52.206935 23442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:52.207410 23442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:52.207590 23442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:52.215484 23442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:52.215569 23442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:52.215670 23442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:48:52.226547 23442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:52.228168 23442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:52.230018 23442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:52.242949 23447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:52.243053 23448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:52.243047 23450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:52.243973 23442 server_base.cc:1034] running on GCE node
I20260806 04:48:52.244589 23442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:52.245415 23442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:52.246592 23442 hybrid_clock.cc:648] HybridClock initialized: now 1785991732246561 us; error 28 us; skew 500 ppm
I20260806 04:48:52.246847 23442 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:52 dist-test-slave-0b58 krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991732, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:52.250041 23442 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:48:52.251480 23442 webserver.cc:460] Webserver started at http://127.7.113.193:46133/ using document root <none> and password file <none>
I20260806 04:48:52.252146 23442 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:52.252314 23442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:52.252630 23442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:48:52.255379 23442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "aaccf143f12c48b9aceced4a4d4e9696"
format_stamp: "Formatted at 2026-08-06 04:48:52 on dist-test-slave-0b58"
server_key: "e7456ea079b646a77ba9eb56fb3d8013"
server_key_iv: "93145e93eb3ab3b8e2c75fdefbae6d1f"
server_key_version: "encryptionkey@0"
I20260806 04:48:52.256139 23442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "aaccf143f12c48b9aceced4a4d4e9696"
format_stamp: "Formatted at 2026-08-06 04:48:52 on dist-test-slave-0b58"
server_key: "e7456ea079b646a77ba9eb56fb3d8013"
server_key_iv: "93145e93eb3ab3b8e2c75fdefbae6d1f"
server_key_version: "encryptionkey@0"
I20260806 04:48:52.261164 23442 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 04:48:52.264379 23458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:52.265552 23442 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 04:48:52.265719 23442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "aaccf143f12c48b9aceced4a4d4e9696"
format_stamp: "Formatted at 2026-08-06 04:48:52 on dist-test-slave-0b58"
server_key: "e7456ea079b646a77ba9eb56fb3d8013"
server_key_iv: "93145e93eb3ab3b8e2c75fdefbae6d1f"
server_key_version: "encryptionkey@0"
I20260806 04:48:52.265909 23442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:52.280727 23442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:52.284512 23442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:52.284790 23442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:52.285702 23442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:52.286980 23442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:52.287086 23442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:52.287231 23442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:52.287318 23442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:52.320333 23442 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:39317
I20260806 04:48:52.320421 23571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:39317 every 8 connection(s)
I20260806 04:48:52.321589 23442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:48:52.331393 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 23442
I20260806 04:48:52.331622 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:48:52.332491 7623 external_mini_cluster.cc:1428] Setting key cd6f448a539c6c8d5183c17cd117aa39
Aug 06 04:48:52 dist-test-slave-0b58 krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991732, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:52.341400 23574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:52.323975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:38537 (local address 127.7.113.254:42335)
0806 04:48:52.324548 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:52.324554 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:52.325461 (+ 907us) server_negotiation.cc:407] Connection header received
0806 04:48:52.327205 (+ 1744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:52.327209 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:52.327282 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:52.327378 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:52.328826 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:52.329565 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:52.331111 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:52.331765 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:52.331910 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:52.335723 (+ 3813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:52.335729 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:52.335732 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:52.335763 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:52.338379 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:52.339084 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:52.339094 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:52.339097 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:52.339212 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:52.339656 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:52.339660 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:52.339665 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:52.339925 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:52.340084 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:52.340804 (+ 720us) server_negotiation.cc:299] Negotiation successful
0806 04:48:52.341020 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":273,"threads_started":1}
I20260806 04:48:52.342295 23575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:52.324534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:38537)
0806 04:48:52.325298 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:52.325353 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:52.326951 (+ 1598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:52.327579 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:52.327587 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:52.328059 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:52.328664 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:52.328682 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:52.329703 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:52.329707 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:52.330970 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:52.330982 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:52.331990 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:52.331999 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:52.332305 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:52.333023 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:52.333044 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:52.335503 (+ 2459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:52.338525 (+ 3022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:52.338534 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:52.338548 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:52.338956 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:52.339336 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:52.339341 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:52.339344 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:52.339534 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:52.340057 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:52.340064 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:52.340442 (+ 378us) client_negotiation.cc:769] Sending connection context
0806 04:48:52.340693 (+ 251us) client_negotiation.cc:240] Negotiation successful
0806 04:48:52.341192 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":295,"threads_started":1}
I20260806 04:48:52.343874 23572 heartbeater.cc:347] Connected to a master server at 127.7.113.254:42335
I20260806 04:48:52.344165 23572 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:52.344901 23572 heartbeater.cc:511] Master 127.7.113.254:42335 requested a full tablet report, sending...
I20260806 04:48:52.346951 23381 ts_manager.cc:194] Registered new tserver with Master: aaccf143f12c48b9aceced4a4d4e9696 (127.7.113.193:39317)
I20260806 04:48:52.348444 23381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:38537
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:48:52.389479 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42335
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:52.709823 23578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:52.710078 23578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:52.710299 23578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:52.717191 23578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:52.717278 23578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:52.717468 23578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:48:52.726913 23578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:52.728088 23578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:52.729321 23578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:52.742290 23583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:52.742378 23584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:52.742341 23586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:52.743080 23578 server_base.cc:1034] running on GCE node
I20260806 04:48:52.743641 23578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:52.744493 23578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:52.745679 23578 hybrid_clock.cc:648] HybridClock initialized: now 1785991732745617 us; error 54 us; skew 500 ppm
I20260806 04:48:52.745962 23578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:52 dist-test-slave-0b58 krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991732, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:52.749006 23578 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:48:52.750394 23578 webserver.cc:460] Webserver started at http://127.7.113.194:36143/ using document root <none> and password file <none>
I20260806 04:48:52.751101 23578 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:52.751235 23578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:52.751551 23578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:48:52.754381 23578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "ce83ea8f34ab416caab176440a6464f1"
format_stamp: "Formatted at 2026-08-06 04:48:52 on dist-test-slave-0b58"
server_key: "4a20842155ab60ae3192cd7ea840103c"
server_key_iv: "0de6bda86b0dcf0919175fca348a7ce6"
server_key_version: "encryptionkey@0"
I20260806 04:48:52.755141 23578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "ce83ea8f34ab416caab176440a6464f1"
format_stamp: "Formatted at 2026-08-06 04:48:52 on dist-test-slave-0b58"
server_key: "4a20842155ab60ae3192cd7ea840103c"
server_key_iv: "0de6bda86b0dcf0919175fca348a7ce6"
server_key_version: "encryptionkey@0"
I20260806 04:48:52.760057 23578 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 04:48:52.763303 23595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:52.764535 23578 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 04:48:52.764709 23578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "ce83ea8f34ab416caab176440a6464f1"
format_stamp: "Formatted at 2026-08-06 04:48:52 on dist-test-slave-0b58"
server_key: "4a20842155ab60ae3192cd7ea840103c"
server_key_iv: "0de6bda86b0dcf0919175fca348a7ce6"
server_key_version: "encryptionkey@0"
I20260806 04:48:52.764894 23578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:52.780791 23578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:52.784417 23578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:52.784689 23578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:52.785566 23578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:52.786795 23578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:52.786885 23578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:52.787056 23578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:52.787106 23578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:52.820612 23578 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:33255
I20260806 04:48:52.820654 23707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:33255 every 8 connection(s)
I20260806 04:48:52.821867 23578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:48:52.832338 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 23578
I20260806 04:48:52.832535 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:48:52.833114 7623 external_mini_cluster.cc:1428] Setting key 600aae0b7f814a841bb8e754826a3a16
Aug 06 04:48:52 dist-test-slave-0b58 krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991732, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:52.841682 23574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:52.824335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:57297 (local address 127.7.113.254:42335)
0806 04:48:52.824541 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:52.824548 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:52.825730 (+ 1182us) server_negotiation.cc:407] Connection header received
0806 04:48:52.827462 (+ 1732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:52.827466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:52.827533 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:52.827619 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:52.829053 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:52.829744 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:52.831287 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:52.831786 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:52.831897 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:52.835997 (+ 4100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:52.836003 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:52.836006 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:52.836038 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:52.838653 (+ 2615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:52.839384 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:52.839394 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:52.839397 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:52.839519 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:52.839952 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:52.839957 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:52.839966 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:52.840223 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:52.840409 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:52.841087 (+ 678us) server_negotiation.cc:299] Negotiation successful
0806 04:48:52.841326 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 04:48:52.842621 23710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:52.824835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:57297)
0806 04:48:52.825579 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:52.825621 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:52.827210 (+ 1589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:52.827813 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:52.827821 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:52.828371 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:52.828907 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:52.828925 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:52.829881 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:52.829884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:52.831150 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:52.831161 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:52.832025 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:52.832037 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:52.832373 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:52.833062 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:52.833091 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:52.835746 (+ 2655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:52.838805 (+ 3059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:52.838814 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:52.838830 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:52.839244 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:52.839634 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:52.839639 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:52.839643 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:52.839829 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:52.840380 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:52.840388 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:52.840723 (+ 335us) client_negotiation.cc:769] Sending connection context
0806 04:48:52.840984 (+ 261us) client_negotiation.cc:240] Negotiation successful
0806 04:48:52.841507 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":269,"threads_started":1}
I20260806 04:48:52.843999 23708 heartbeater.cc:347] Connected to a master server at 127.7.113.254:42335
I20260806 04:48:52.844357 23708 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:52.845082 23708 heartbeater.cc:511] Master 127.7.113.254:42335 requested a full tablet report, sending...
I20260806 04:48:52.846513 23381 ts_manager.cc:194] Registered new tserver with Master: ce83ea8f34ab416caab176440a6464f1 (127.7.113.194:33255)
I20260806 04:48:52.847340 23381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:57297
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:48:52.891651 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42335
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:48:53.241505 23713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:48:53.241801 23713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:48:53.241964 23713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:48:53.249027 23713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:48:53.249174 23713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:48:53.249342 23713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:48:53.258770 23713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:42335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:48:53.259934 23713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:48:53.261202 23713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:48:53.274235 23718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:53.274147 23721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:48:53.274179 23719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:48:53.275111 23713 server_base.cc:1034] running on GCE node
I20260806 04:48:53.275725 23713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:48:53.276680 23713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:48:53.277878 23713 hybrid_clock.cc:648] HybridClock initialized: now 1785991733277829 us; error 38 us; skew 500 ppm
I20260806 04:48:53.278182 23713 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:48:53 dist-test-slave-0b58 krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991733, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:48:53.281292 23713 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:48:53.282617 23713 webserver.cc:460] Webserver started at http://127.7.113.195:40903/ using document root <none> and password file <none>
I20260806 04:48:53.283255 23713 fs_manager.cc:359] Metadata directory not provided
I20260806 04:48:53.283401 23713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:48:53.283727 23713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:48:53.286633 23713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "147dce0a455c4161bd7b6e6f5d230ddc"
format_stamp: "Formatted at 2026-08-06 04:48:53 on dist-test-slave-0b58"
server_key: "94a12c70c4d67d0fdaf9ae616e16ed74"
server_key_iv: "3e0811fddcb852837c073c0ee5f4941d"
server_key_version: "encryptionkey@0"
I20260806 04:48:53.287384 23713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "147dce0a455c4161bd7b6e6f5d230ddc"
format_stamp: "Formatted at 2026-08-06 04:48:53 on dist-test-slave-0b58"
server_key: "94a12c70c4d67d0fdaf9ae616e16ed74"
server_key_iv: "3e0811fddcb852837c073c0ee5f4941d"
server_key_version: "encryptionkey@0"
I20260806 04:48:53.292567 23713 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 04:48:53.295854 23728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:53.297142 23713 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:48:53.297324 23713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "147dce0a455c4161bd7b6e6f5d230ddc"
format_stamp: "Formatted at 2026-08-06 04:48:53 on dist-test-slave-0b58"
server_key: "94a12c70c4d67d0fdaf9ae616e16ed74"
server_key_iv: "3e0811fddcb852837c073c0ee5f4941d"
server_key_version: "encryptionkey@0"
I20260806 04:48:53.297515 23713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:48:53.314877 23713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:48:53.319242 23713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:48:53.319546 23713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:48:53.320744 23713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:48:53.322047 23713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:48:53.322170 23713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:53.322319 23713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:48:53.322393 23713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:48:53.351125 23572 heartbeater.cc:503] Master 127.7.113.254:42335 was elected leader, sending a full tablet report...
I20260806 04:48:53.355706 23713 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:36645
I20260806 04:48:53.355780 23843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:36645 every 8 connection(s)
I20260806 04:48:53.356993 23713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:48:53.366868 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 23713
I20260806 04:48:53.367079 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:48:53.367570 7623 external_mini_cluster.cc:1428] Setting key be8b065aeefc5725f0d3844b443cc75e
Aug 06 04:48:53 dist-test-slave-0b58 krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991733, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:48:53.375945 23846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.359398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:33127 (local address 127.7.113.254:42335)
0806 04:48:53.359847 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:53.359852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:53.360655 (+ 803us) server_negotiation.cc:407] Connection header received
0806 04:48:53.362404 (+ 1749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:53.362409 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:53.362497 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:53.362623 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:53.364015 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.364887 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.366385 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.366786 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.366926 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.370818 (+ 3892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:53.370822 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:53.370825 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:53.370864 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:53.373530 (+ 2666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:53.374172 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:53.374176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:53.374178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:53.374287 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:53.374622 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:53.374625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:53.374627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:53.374868 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:53.374973 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:53.375533 (+ 560us) server_negotiation.cc:299] Negotiation successful
0806 04:48:53.375683 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":254,"threads_started":1}
I20260806 04:48:53.376832 23847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.359832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:33127)
0806 04:48:53.360523 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:53.360557 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:53.362159 (+ 1602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:53.362855 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:53.362862 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:53.363338 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:48:53.363837 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:53.363863 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.365042 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.365045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:53.366242 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:53.366253 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.367010 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.367018 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:53.367319 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.368057 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:48:53.368116 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:48:53.370634 (+ 2518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:48:53.373652 (+ 3018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:53.373658 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:53.373668 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:53.374065 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:53.374376 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:48:53.374379 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:48:53.374381 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:48:53.374535 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:48:53.374967 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:48:53.374972 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:48:53.375252 (+ 280us) client_negotiation.cc:769] Sending connection context
0806 04:48:53.375459 (+ 207us) client_negotiation.cc:240] Negotiation successful
0806 04:48:53.375781 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":260,"threads_started":1}
I20260806 04:48:53.378110 23844 heartbeater.cc:347] Connected to a master server at 127.7.113.254:42335
I20260806 04:48:53.378417 23844 heartbeater.cc:464] Registering TS with master...
I20260806 04:48:53.379081 23844 heartbeater.cc:511] Master 127.7.113.254:42335 requested a full tablet report, sending...
I20260806 04:48:53.380434 23381 ts_manager.cc:194] Registered new tserver with Master: 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645)
I20260806 04:48:53.381341 23381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:33127
I20260806 04:48:53.382839 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:48:53.400192 23846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.388085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43692 (local address 127.7.113.254:42335)
0806 04:48:53.388256 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:53.388261 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:53.388728 (+ 467us) server_negotiation.cc:407] Connection header received
0806 04:48:53.388922 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:53.388927 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:53.388994 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:53.389085 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:53.390505 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.391176 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.392546 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.392969 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.393100 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.395341 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:53.395349 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:53.395359 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:53.395387 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:53.397634 (+ 2247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:53.398306 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:53.398312 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:53.398315 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:53.398430 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:53.398774 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:53.398781 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:53.398784 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:53.399081 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:53.399318 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:53.399648 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 04:48:53.399872 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 04:48:53.403985 23381 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43692:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:48:53.410823 23381 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:48:53.445608 23858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.422193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36640 (local address 127.7.113.195:36645)
0806 04:48:53.434520 (+ 12327us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:53.434532 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:53.435508 (+ 976us) server_negotiation.cc:407] Connection header received
0806 04:48:53.435951 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:53.435963 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:53.436280 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:53.436456 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:53.437559 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.439531 (+ 1972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.442745 (+ 3214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.444149 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.444289 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.444557 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:53.445091 (+ 534us) server_negotiation.cc:299] Negotiation successful
0806 04:48:53.445247 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12100,"thread_start_us":12331,"threads_started":1}
I20260806 04:48:53.445683 23857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.421919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:36645 (local address 127.0.0.1:36640)
0806 04:48:53.435306 (+ 13387us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:53.435352 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:53.435676 (+ 324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:53.436875 (+ 1199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:53.436885 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:53.436924 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:53.437344 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:53.437359 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.439745 (+ 2386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.439753 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:53.442506 (+ 2753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:53.442527 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.444682 (+ 2155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.444687 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:53.444882 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.444918 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 04:48:53.445049 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 04:48:53.445234 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13094,"thread_start_us":12964,"threads_started":1}
I20260806 04:48:53.449748 23777 tablet_service.cc:1467] Processing CreateTablet for tablet 496ed5f2a3e1429b97e2cebb58f20aae (DEFAULT_TABLE table=test-table [id=bf775c952b6b44198024d2e834f3af79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:48:53.451107 23859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.422354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:33255 (local address 127.0.0.1:39086)
0806 04:48:53.441453 (+ 19099us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:53.441476 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:53.441625 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:53.442440 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:53.442448 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:53.442478 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:53.442925 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:53.442937 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.445423 (+ 2486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.445431 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:53.447743 (+ 2312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:53.447759 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.450217 (+ 2458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.450223 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:53.450394 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.450427 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 04:48:53.450526 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 04:48:53.450655 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18939,"mutex_wait_us":23,"thread_start_us":18735,"threads_started":1}
I20260806 04:48:53.451423 23862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.423376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35096 (local address 127.7.113.193:39317)
0806 04:48:53.440382 (+ 17006us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:53.440395 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:53.442586 (+ 2191us) server_negotiation.cc:407] Connection header received
0806 04:48:53.442860 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:53.442869 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:53.443069 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:53.443267 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:53.443852 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.445374 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.448911 (+ 3537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.450315 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.450449 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.450670 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:53.450943 (+ 273us) server_negotiation.cc:299] Negotiation successful
0806 04:48:53.451099 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16792,"thread_start_us":16644,"threads_started":1}
I20260806 04:48:53.451471 23860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.422689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39317 (local address 127.0.0.1:35096)
0806 04:48:53.442458 (+ 19769us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:53.442476 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:53.442698 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:53.443266 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:53.443271 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:53.443307 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:53.443692 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:53.443703 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.445537 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.445550 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:53.448721 (+ 3171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:53.448735 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.450573 (+ 1838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.450581 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:53.450748 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.450784 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 04:48:53.450886 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 04:48:53.451007 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19644,"mutex_wait_us":25,"thread_start_us":19474,"threads_started":1}
I20260806 04:48:53.451535 23777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 496ed5f2a3e1429b97e2cebb58f20aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:53.451824 23861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.422892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39086 (local address 127.7.113.194:33255)
0806 04:48:53.440893 (+ 18001us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:53.440904 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:53.441768 (+ 864us) server_negotiation.cc:407] Connection header received
0806 04:48:53.441901 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:53.441911 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:53.442205 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:53.442392 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:53.443125 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.444606 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.447947 (+ 3341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.450010 (+ 2063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.450156 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.450347 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:53.451379 (+ 1032us) server_negotiation.cc:299] Negotiation successful
0806 04:48:53.451557 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17802,"thread_start_us":17673,"threads_started":1}
I20260806 04:48:53.455282 23643 tablet_service.cc:1467] Processing CreateTablet for tablet 496ed5f2a3e1429b97e2cebb58f20aae (DEFAULT_TABLE table=test-table [id=bf775c952b6b44198024d2e834f3af79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:48:53.455271 23507 tablet_service.cc:1467] Processing CreateTablet for tablet 496ed5f2a3e1429b97e2cebb58f20aae (DEFAULT_TABLE table=test-table [id=bf775c952b6b44198024d2e834f3af79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:48:53.456646 23643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 496ed5f2a3e1429b97e2cebb58f20aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:53.456642 23507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 496ed5f2a3e1429b97e2cebb58f20aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:48:53.462522 23863 tablet_bootstrap.cc:492] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc: Bootstrap starting.
I20260806 04:48:53.465592 23863 tablet_bootstrap.cc:654] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:53.466604 23863 log.cc:824] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:53.471407 23863 tablet_bootstrap.cc:492] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc: No bootstrap required, opened a new log
I20260806 04:48:53.471493 23865 tablet_bootstrap.cc:492] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1: Bootstrap starting.
I20260806 04:48:53.471746 23863 ts_tablet_manager.cc:1397] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260806 04:48:53.475065 23865 tablet_bootstrap.cc:654] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:53.475893 23866 tablet_bootstrap.cc:492] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696: Bootstrap starting.
I20260806 04:48:53.476275 23865 log.cc:824] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:53.479303 23865 tablet_bootstrap.cc:492] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1: No bootstrap required, opened a new log
I20260806 04:48:53.479307 23866 tablet_bootstrap.cc:654] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696: Neither blocks nor log segments found. Creating new log.
I20260806 04:48:53.479588 23865 ts_tablet_manager.cc:1397] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1: Time spent bootstrapping tablet: real 0.008s user 0.008s sys 0.000s
I20260806 04:48:53.480391 23866 log.cc:824] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696: Log is configured to *not* fsync() on all Append() calls
I20260806 04:48:53.481905 23863 raft_consensus.cc:348] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } }
I20260806 04:48:53.482337 23863 raft_consensus.cc:374] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:53.482450 23863 raft_consensus.cc:729] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 147dce0a455c4161bd7b6e6f5d230ddc, State: Initialized, Role: FOLLOWER
I20260806 04:48:53.483048 23866 tablet_bootstrap.cc:492] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696: No bootstrap required, opened a new log
I20260806 04:48:53.483039 23863 consensus_queue.cc:260] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } }
I20260806 04:48:53.483352 23866 ts_tablet_manager.cc:1397] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260806 04:48:53.484109 23844 heartbeater.cc:503] Master 127.7.113.254:42335 was elected leader, sending a full tablet report...
I20260806 04:48:53.485910 23863 ts_tablet_manager.cc:1428] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc: Time spent starting tablet: real 0.014s user 0.008s sys 0.004s
I20260806 04:48:53.488879 23865 raft_consensus.cc:348] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } }
I20260806 04:48:53.489372 23865 raft_consensus.cc:374] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:53.489526 23865 raft_consensus.cc:729] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce83ea8f34ab416caab176440a6464f1, State: Initialized, Role: FOLLOWER
I20260806 04:48:53.490254 23865 consensus_queue.cc:260] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } }
I20260806 04:48:53.491292 23708 heartbeater.cc:503] Master 127.7.113.254:42335 was elected leader, sending a full tablet report...
I20260806 04:48:53.491699 23865 ts_tablet_manager.cc:1428] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260806 04:48:53.492846 23866 raft_consensus.cc:348] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } }
I20260806 04:48:53.493279 23866 raft_consensus.cc:374] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:48:53.493410 23866 raft_consensus.cc:729] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaccf143f12c48b9aceced4a4d4e9696, State: Initialized, Role: FOLLOWER
I20260806 04:48:53.493973 23866 consensus_queue.cc:260] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } }
I20260806 04:48:53.495427 23866 ts_tablet_manager.cc:1428] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
W20260806 04:48:53.573860 23709 tablet.cc:2369] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:48:53.573882 23573 tablet.cc:2369] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:48:53.608784 23845 tablet.cc:2369] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:48:53.647816 23870 raft_consensus.cc:482] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:48:53.648181 23870 raft_consensus.cc:504] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } }
I20260806 04:48:53.649879 23870 leader_election.cc:288] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645), aaccf143f12c48b9aceced4a4d4e9696 (127.7.113.193:39317)
I20260806 04:48:53.656777 23858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.650325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:60675 (local address 127.7.113.195:36645)
0806 04:48:53.650510 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:53.650516 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:53.651273 (+ 757us) server_negotiation.cc:407] Connection header received
0806 04:48:53.651401 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:53.651406 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:53.651484 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:53.651577 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:53.652227 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.653070 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.655033 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.655777 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.655917 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.656001 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:53.656389 (+ 388us) server_negotiation.cc:299] Negotiation successful
0806 04:48:53.656513 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 04:48:53.656786 23862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.650313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:56333 (local address 127.7.113.193:39317)
0806 04:48:53.650510 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:53.650516 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:53.651434 (+ 918us) server_negotiation.cc:407] Connection header received
0806 04:48:53.651604 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:53.651609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:53.651688 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:53.651789 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:48:53.652483 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.653215 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.655074 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.655815 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.655998 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.656067 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:53.656423 (+ 356us) server_negotiation.cc:299] Negotiation successful
0806 04:48:53.656544 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 04:48:53.656966 23872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.650334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39317 (local address 127.7.113.194:56333)
0806 04:48:53.651318 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:53.651334 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:53.651462 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:53.651823 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:53.651826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:53.651845 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:53.652310 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:53.652326 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.653349 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.653353 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:53.654877 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:53.654889 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.656067 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.656071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:53.656214 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.656235 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 04:48:53.656382 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 04:48:53.656506 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":853,"mutex_wait_us":50,"thread_start_us":493,"threads_started":1}
I20260806 04:48:53.657191 23873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.650334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:36645 (local address 127.7.113.194:60675)
0806 04:48:53.651150 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0806 04:48:53.651169 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:48:53.651283 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:48:53.651600 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:48:53.651605 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:48:53.651630 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:48:53.652065 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:53.652077 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.653209 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.653214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:53.654868 (+ 1654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:48:53.654881 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.656003 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.656009 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:48:53.656164 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.656232 (+ 68us) client_negotiation.cc:769] Sending connection context
0806 04:48:53.656364 (+ 132us) client_negotiation.cc:240] Negotiation successful
0806 04:48:53.656488 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"mutex_wait_us":82,"spinlock_wait_cycles":20224,"thread_start_us":488,"threads_started":1}
I20260806 04:48:53.658002 23527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "496ed5f2a3e1429b97e2cebb58f20aae" candidate_uuid: "ce83ea8f34ab416caab176440a6464f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaccf143f12c48b9aceced4a4d4e9696" is_pre_election: true
I20260806 04:48:53.658039 23797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "496ed5f2a3e1429b97e2cebb58f20aae" candidate_uuid: "ce83ea8f34ab416caab176440a6464f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" is_pre_election: true
I20260806 04:48:53.658469 23797 raft_consensus.cc:2454] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce83ea8f34ab416caab176440a6464f1 in term 0.
I20260806 04:48:53.658486 23527 raft_consensus.cc:2454] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce83ea8f34ab416caab176440a6464f1 in term 0.
I20260806 04:48:53.659119 23599 leader_election.cc:302] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaccf143f12c48b9aceced4a4d4e9696, ce83ea8f34ab416caab176440a6464f1; no voters:
I20260806 04:48:53.659492 23870 raft_consensus.cc:2781] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:48:53.659639 23870 raft_consensus.cc:482] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:48:53.659736 23870 raft_consensus.cc:3037] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:53.661921 23870 raft_consensus.cc:504] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } }
I20260806 04:48:53.662637 23870 leader_election.cc:288] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [CANDIDATE]: Term 1 election: Requested vote from peers 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645), aaccf143f12c48b9aceced4a4d4e9696 (127.7.113.193:39317)
I20260806 04:48:53.662992 23797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "496ed5f2a3e1429b97e2cebb58f20aae" candidate_uuid: "ce83ea8f34ab416caab176440a6464f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "147dce0a455c4161bd7b6e6f5d230ddc"
I20260806 04:48:53.663125 23527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "496ed5f2a3e1429b97e2cebb58f20aae" candidate_uuid: "ce83ea8f34ab416caab176440a6464f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaccf143f12c48b9aceced4a4d4e9696"
I20260806 04:48:53.663189 23797 raft_consensus.cc:3037] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:53.663329 23527 raft_consensus.cc:3037] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:48:53.666322 23797 raft_consensus.cc:2454] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce83ea8f34ab416caab176440a6464f1 in term 1.
I20260806 04:48:53.666412 23527 raft_consensus.cc:2454] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce83ea8f34ab416caab176440a6464f1 in term 1.
I20260806 04:48:53.666762 23599 leader_election.cc:302] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 147dce0a455c4161bd7b6e6f5d230ddc, aaccf143f12c48b9aceced4a4d4e9696, ce83ea8f34ab416caab176440a6464f1; no voters:
I20260806 04:48:53.667097 23870 raft_consensus.cc:2781] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:48:53.667567 23870 raft_consensus.cc:686] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [term 1 LEADER]: Becoming Leader. State: Replica: ce83ea8f34ab416caab176440a6464f1, State: Running, Role: LEADER
I20260806 04:48:53.667995 23870 consensus_queue.cc:237] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } }
I20260806 04:48:53.672475 23381 catalog_manager.cc:5495] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce83ea8f34ab416caab176440a6464f1 (127.7.113.194). New cstate: current_term: 1 leader_uuid: "ce83ea8f34ab416caab176440a6464f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } health_report { overall_health: UNKNOWN } } }
I20260806 04:48:53.743494 23861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.738443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39094 (local address 127.7.113.194:33255)
0806 04:48:53.738622 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:53.738627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:53.738645 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:48:53.738826 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:53.738830 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:53.738924 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:53.739045 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:48:53.739362 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.740058 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.741496 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.741914 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.742007 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.742435 (+ 428us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:48:53.742920 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:48:53.743026 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:53.743104 (+ 78us) server_negotiation.cc:299] Negotiation successful
0806 04:48:53.743164 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 04:48:53.751184 23797 raft_consensus.cc:1261] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc [term 1 FOLLOWER]: Refusing update from remote peer ce83ea8f34ab416caab176440a6464f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:48:53.751223 23527 raft_consensus.cc:1261] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Refusing update from remote peer ce83ea8f34ab416caab176440a6464f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:48:53.752293 23874 consensus_queue.cc:1035] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:48:53.752624 23870 consensus_queue.cc:1035] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:48:53.763468 23877 mvcc.cc:205] Tried to move back new op lower bound from 7315422141435416576 to 7315422141108428800. Current Snapshot: MvccSnapshot[applied={T|T < 7315422141435416576}]
I20260806 04:48:53.765105 23879 mvcc.cc:205] Tried to move back new op lower bound from 7315422141435416576 to 7315422141108428800. Current Snapshot: MvccSnapshot[applied={T|T < 7315422141435416576}]
I20260806 04:48:53.767043 23878 mvcc.cc:205] Tried to move back new op lower bound from 7315422141435416576 to 7315422141108428800. Current Snapshot: MvccSnapshot[applied={T|T < 7315422141435416576}]
I20260806 04:48:53.776084 23381 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43692:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:48:53.776439 23381 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43692:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:48:53.780459 23381 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Sending DeleteTablet for 3 replicas of tablet 496ed5f2a3e1429b97e2cebb58f20aae
I20260806 04:48:53.781433 23777 tablet_service.cc:1514] Processing DeleteTablet for tablet 496ed5f2a3e1429b97e2cebb58f20aae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:48:53 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:36640
I20260806 04:48:53.781476 23643 tablet_service.cc:1514] Processing DeleteTablet for tablet 496ed5f2a3e1429b97e2cebb58f20aae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:48:53 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:39086
I20260806 04:48:53.782317 23888 tablet_replica.cc:330] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc: stopping tablet replica
I20260806 04:48:53.782630 23507 tablet_service.cc:1514] Processing DeleteTablet for tablet 496ed5f2a3e1429b97e2cebb58f20aae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:48:53 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:35096
I20260806 04:48:53.782790 23888 raft_consensus.cc:2229] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:48:53.783074 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 23442
I20260806 04:48:53.783373 23888 raft_consensus.cc:2258] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:48:53.784102 23887 tablet_replica.cc:330] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1: stopping tablet replica
I20260806 04:48:53.784487 23887 raft_consensus.cc:2229] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:48:53.785059 23887 raft_consensus.cc:2258] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:48:53.786634 23887 ts_tablet_manager.cc:1905] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:48:53.791951 23888 ts_tablet_manager.cc:1905] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:48:53.793493 23887 ts_tablet_manager.cc:1918] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:48:53.793707 23887 log.cc:1196] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/496ed5f2a3e1429b97e2cebb58f20aae
I20260806 04:48:53.794317 23887 ts_tablet_manager.cc:1939] T 496ed5f2a3e1429b97e2cebb58f20aae P ce83ea8f34ab416caab176440a6464f1: Deleting consensus metadata
I20260806 04:48:53.795850 23889 tablet_replica.cc:330] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696: stopping tablet replica
I20260806 04:48:53.796293 23889 raft_consensus.cc:2229] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:48:53.796728 23365 catalog_manager.cc:4841] TS ce83ea8f34ab416caab176440a6464f1 (127.7.113.194:33255): tablet 496ed5f2a3e1429b97e2cebb58f20aae (table test-table [id=bf775c952b6b44198024d2e834f3af79]) successfully deleted
I20260806 04:48:53.797248 23889 raft_consensus.cc:2258] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:48:53.798960 23889 ts_tablet_manager.cc:1905] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:48:53.800485 23888 ts_tablet_manager.cc:1918] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:48:53.800890 23888 log.cc:1196] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/496ed5f2a3e1429b97e2cebb58f20aae
I20260806 04:48:53.801476 23888 ts_tablet_manager.cc:1939] T 496ed5f2a3e1429b97e2cebb58f20aae P 147dce0a455c4161bd7b6e6f5d230ddc: Deleting consensus metadata
I20260806 04:48:53.803162 23367 catalog_manager.cc:4841] TS 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645): tablet 496ed5f2a3e1429b97e2cebb58f20aae (table test-table [id=bf775c952b6b44198024d2e834f3af79]) successfully deleted
Aug 06 04:48:53 dist-test-slave-0b58 krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:48:53.808923 23889 ts_tablet_manager.cc:1918] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:48:53.809093 23889 log.cc:1196] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/496ed5f2a3e1429b97e2cebb58f20aae
I20260806 04:48:53.809641 23889 ts_tablet_manager.cc:1939] T 496ed5f2a3e1429b97e2cebb58f20aae P aaccf143f12c48b9aceced4a4d4e9696: Deleting consensus metadata
I20260806 04:48:53.810725 23862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.784754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35100 (local address 127.7.113.193:39317)
0806 04:48:53.784969 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:53.784977 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:53.784999 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:48:53.785064 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:53.785071 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:53.785170 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:53.785280 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:53.790422 (+ 5142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.791566 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.793718 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.794475 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.794583 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.804642 (+ 10059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:53.804654 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:53.804665 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:53.804701 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:53.807703 (+ 3002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:53.808446 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:53.808453 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:53.808455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:53.808592 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:53.809001 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:53.809008 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:53.809011 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:53.809449 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:53.809813 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:53.810106 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 04:48:53.810323 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 04:48:53.811432 23567 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:53.811403 23368 catalog_manager.cc:4841] TS aaccf143f12c48b9aceced4a4d4e9696 (127.7.113.193:39317): tablet 496ed5f2a3e1429b97e2cebb58f20aae (table test-table [id=bf775c952b6b44198024d2e834f3af79]) successfully deleted
I20260806 04:48:53.939543 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 23442
I20260806 04:48:53.959270 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 23578
Aug 06 04:48:53 dist-test-slave-0b58 krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:48:53.976151 23861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:53.960248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39104 (local address 127.7.113.194:33255)
0806 04:48:53.960507 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:53.960513 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:53.960533 (+ 20us) server_negotiation.cc:407] Connection header received
0806 04:48:53.960609 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:53.960615 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:53.960698 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:53.960828 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:53.962152 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.963030 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.964524 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:53.964958 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:53.965103 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:53.969361 (+ 4258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:53.969376 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:53.969395 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:53.969440 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:53.973373 (+ 3933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:53.974007 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:53.974022 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:53.974025 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:53.974191 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:53.974550 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:53.974555 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:53.974559 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:53.975043 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:53.975363 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:53.975526 (+ 163us) server_negotiation.cc:299] Negotiation successful
0806 04:48:53.975748 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 04:48:53.976974 23703 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:54.086751 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 23578
I20260806 04:48:54.107623 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 23713
Aug 06 04:48:54 dist-test-slave-0b58 krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:48:54.123302 23858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:48:54.108441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36654 (local address 127.7.113.195:36645)
0806 04:48:54.108624 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 04:48:54.108628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:48:54.108646 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:48:54.108797 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:48:54.108801 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:48:54.108863 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:48:54.108958 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:48:54.110507 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:54.111268 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:54.112663 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:48:54.113040 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:48:54.113132 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:48:54.117575 (+ 4443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:48:54.117589 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:48:54.117605 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:48:54.117637 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:48:54.120400 (+ 2763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:54.121189 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:54.121196 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:54.121198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:54.121348 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:48:54.121757 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:48:54.121762 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:48:54.121764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:48:54.122086 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:48:54.122404 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0806 04:48:54.122726 (+ 322us) server_negotiation.cc:299] Negotiation successful
0806 04:48:54.122952 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 04:48:54.123951 23839 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:54.210438 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 23713
I20260806 04:48:54.232445 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 23349
I20260806 04:48:54.233752 23411 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:48:54.343480 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 23349
I20260806 04:49:14.368448 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42335
--webserver_interface=127.7.113.254
--webserver_port=38033
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:42335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:49:14.701088 23895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:49:14.701418 23895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:49:14.701578 23895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:49:14.708667 23895 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 04:49:14.708786 23895 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 04:49:14.708877 23895 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 04:49:14.708977 23895 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:49:14.709077 23895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:49:14.709183 23895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:49:14.709256 23895 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:49:14.709344 23895 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:49:14.718936 23895 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:42335
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=38033
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:49:14.720139 23895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:49:14.721458 23895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:49:14.746567 23902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:14.746487 23904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:14.746542 23901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:49:14.746835 23895 server_base.cc:1034] running on GCE node
I20260806 04:49:14.748032 23895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:49:14.749663 23895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:49:14.750921 23895 hybrid_clock.cc:648] HybridClock initialized: now 1785991754750877 us; error 64 us; skew 500 ppm
I20260806 04:49:14.751319 23895 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:49:14 dist-test-slave-0b58 krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991754, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:49:14.758484 23895 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:49:14.760210 23895 webserver.cc:460] Webserver started at http://127.7.113.254:38033/ using document root <none> and password file <none>
I20260806 04:49:14.761023 23895 fs_manager.cc:359] Metadata directory not provided
I20260806 04:49:14.761184 23895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:49:14.767140 23895 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 04:49:14.770061 23911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:14.771406 23895 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 04:49:14.771600 23895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "59c440f4b7cf4328a241e648c803b3fe"
format_stamp: "Formatted at 2026-08-06 04:48:51 on dist-test-slave-0b58"
server_key: "b608a369d5a95f480508b824774c90ce"
server_key_iv: "19177ab49d71e4f6fb11e258e429cf2f"
server_key_version: "encryptionkey@0"
I20260806 04:49:14.772723 23895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:49:14.789218 23895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:49:14.793316 23895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:49:14.793620 23895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:49:14.812700 23895 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:42335
I20260806 04:49:14.812722 23963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:42335 every 8 connection(s)
I20260806 04:49:14.814170 23895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:49:14.817152 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 23895
I20260806 04:49:14.818208 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:39317
--local_ip_for_outbound_sockets=127.7.113.193
--tserver_master_addrs=127.7.113.254:42335
--webserver_port=46133
--webserver_interface=127.7.113.193
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:49:14.822971 23964 sys_catalog.cc:263] Verifying existing consensus state
I20260806 04:49:14.828047 23964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Bootstrap starting.
I20260806 04:49:14.848023 23964 log.cc:824] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Log is configured to *not* fsync() on all Append() calls
I20260806 04:49:14.859753 23964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 04:49:14.860327 23964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Bootstrap complete.
I20260806 04:49:14.869458 23964 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } }
I20260806 04:49:14.870262 23964 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59c440f4b7cf4328a241e648c803b3fe, State: Initialized, Role: FOLLOWER
I20260806 04:49:14.870870 23964 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } }
I20260806 04:49:14.871107 23964 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:49:14.871233 23964 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:49:14.871409 23964 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 1 FOLLOWER]: Advancing to term 2
I20260806 04:49:14.875065 23964 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } }
I20260806 04:49:14.875571 23964 leader_election.cc:302] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59c440f4b7cf4328a241e648c803b3fe; no voters:
I20260806 04:49:14.876181 23964 leader_election.cc:288] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 04:49:14.876379 23968 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 2 FOLLOWER]: Leader election won for term 2
I20260806 04:49:14.878652 23964 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:49:14.883219 23968 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 2 LEADER]: Becoming Leader. State: Replica: 59c440f4b7cf4328a241e648c803b3fe, State: Running, Role: LEADER
I20260806 04:49:14.884513 23968 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } }
I20260806 04:49:14.887095 23982 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 04:49:14.887317 23969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "59c440f4b7cf4328a241e648c803b3fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } } }
I20260806 04:49:14.887682 23969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: This master's current role is: LEADER
I20260806 04:49:14.888475 23970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59c440f4b7cf4328a241e648c803b3fe. Latest consensus state: current_term: 2 leader_uuid: "59c440f4b7cf4328a241e648c803b3fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } } }
I20260806 04:49:14.888761 23970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: This master's current role is: LEADER
I20260806 04:49:14.889464 23985 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:49:14.896848 23985 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:49:14.898175 23985 catalog_manager.cc:1259] Loaded cluster ID: 152d0872dbac444b9355a655d959ec72
I20260806 04:49:14.898283 23985 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:49:14.902200 23985 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:49:14.903604 23985 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Loaded TSK: 0
I20260806 04:49:14.935580 23985 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Generated new TSK 1
I20260806 04:49:14.935956 23985 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 04:49:15.156508 23966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:49:15.156802 23966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:49:15.156961 23966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:49:15.163954 23966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:49:15.164129 23966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:49:15.164364 23966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:49:15.174088 23966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:39317
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=46133
--tserver_master_addrs=127.7.113.254:42335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:49:15.175357 23966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:49:15.176892 23966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:49:15.190672 23993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:15.190889 23992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:15.191660 23995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:49:15.191799 23966 server_base.cc:1034] running on GCE node
I20260806 04:49:15.192489 23966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:49:15.193390 23966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:49:15.194615 23966 hybrid_clock.cc:648] HybridClock initialized: now 1785991755194556 us; error 53 us; skew 500 ppm
I20260806 04:49:15.194922 23966 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:49:15 dist-test-slave-0b58 krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991755, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:49:15.198155 23966 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:49:15.199684 23966 webserver.cc:460] Webserver started at http://127.7.113.193:46133/ using document root <none> and password file <none>
I20260806 04:49:15.200400 23966 fs_manager.cc:359] Metadata directory not provided
I20260806 04:49:15.200541 23966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:49:15.205713 23966 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260806 04:49:15.208540 24002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:15.210006 23966 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:49:15.210196 23966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "aaccf143f12c48b9aceced4a4d4e9696"
format_stamp: "Formatted at 2026-08-06 04:48:52 on dist-test-slave-0b58"
server_key: "e7456ea079b646a77ba9eb56fb3d8013"
server_key_iv: "93145e93eb3ab3b8e2c75fdefbae6d1f"
server_key_version: "encryptionkey@0"
I20260806 04:49:15.211205 23966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:49:15.233611 23966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:49:15.237721 23966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:49:15.238003 23966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:49:15.239097 23966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:49:15.240481 23966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:49:15.240613 23966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:15.240739 23966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:49:15.240823 23966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:15.275478 23966 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:39317
I20260806 04:49:15.275563 24114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:39317 every 8 connection(s)
I20260806 04:49:15.277061 23966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:49:15.278721 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 23966
I20260806 04:49:15.279512 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:33255
--local_ip_for_outbound_sockets=127.7.113.194
--tserver_master_addrs=127.7.113.254:42335
--webserver_port=36143
--webserver_interface=127.7.113.194
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 04:49:15 dist-test-slave-0b58 krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991755, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:49:15.307555 24117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:15.280220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:35037 (local address 127.7.113.254:42335)
0806 04:49:15.289054 (+ 8834us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:15.289072 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:15.289125 (+ 53us) server_negotiation.cc:407] Connection header received
0806 04:49:15.289509 (+ 384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:15.289529 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:15.290024 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:15.290428 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:15.292193 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:15.293802 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:15.295312 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:15.295968 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:15.296187 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:15.300107 (+ 3920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:15.300115 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:15.300128 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:15.300169 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:15.303131 (+ 2962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:15.304093 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:15.304099 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:15.304104 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:15.304328 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:15.304823 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:15.304826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:15.304828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:15.305255 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:15.305385 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:15.306401 (+ 1016us) server_negotiation.cc:299] Negotiation successful
0806 04:49:15.306690 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8557,"thread_start_us":8376,"threads_started":1}
I20260806 04:49:15.308208 24118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:15.280441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:35037)
0806 04:49:15.281544 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:15.281622 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:15.284861 (+ 3239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:15.290589 (+ 5728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:15.290601 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:15.291316 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:49:15.291964 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:15.291983 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:15.293955 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:15.293959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:15.295158 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:15.295170 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:15.296248 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:15.296276 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:15.296538 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:15.297313 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:49:15.297340 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:49:15.299837 (+ 2497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:49:15.303279 (+ 3442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:15.303290 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:15.303306 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:15.303941 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:15.304445 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:15.304453 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:15.304459 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:15.304711 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:15.305416 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:49:15.305428 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:49:15.305888 (+ 460us) client_negotiation.cc:769] Sending connection context
0806 04:49:15.306242 (+ 354us) client_negotiation.cc:240] Negotiation successful
0806 04:49:15.306846 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":407,"threads_started":1}
I20260806 04:49:15.311331 24115 heartbeater.cc:347] Connected to a master server at 127.7.113.254:42335
I20260806 04:49:15.311620 24115 heartbeater.cc:464] Registering TS with master...
I20260806 04:49:15.312381 24115 heartbeater.cc:511] Master 127.7.113.254:42335 requested a full tablet report, sending...
I20260806 04:49:15.314843 23928 ts_manager.cc:194] Registered new tserver with Master: aaccf143f12c48b9aceced4a4d4e9696 (127.7.113.193:39317)
I20260806 04:49:15.316926 23928 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:35037
W20260806 04:49:15.615785 24119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:49:15.616094 24119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:49:15.616307 24119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:49:15.623442 24119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:49:15.623591 24119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:49:15.623771 24119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:49:15.633222 24119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:33255
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=36143
--tserver_master_addrs=127.7.113.254:42335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:49:15.634505 24119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:49:15.635799 24119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:49:15.648556 24124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:15.648512 24125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:15.648595 24127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:49:15.649524 24119 server_base.cc:1034] running on GCE node
I20260806 04:49:15.650106 24119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:49:15.651028 24119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:49:15.652318 24119 hybrid_clock.cc:648] HybridClock initialized: now 1785991755652277 us; error 47 us; skew 500 ppm
I20260806 04:49:15.652722 24119 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:49:15 dist-test-slave-0b58 krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991755, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:49:15.657259 24119 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:49:15.658598 24119 webserver.cc:460] Webserver started at http://127.7.113.194:36143/ using document root <none> and password file <none>
I20260806 04:49:15.659236 24119 fs_manager.cc:359] Metadata directory not provided
I20260806 04:49:15.659354 24119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:49:15.664527 24119 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 04:49:15.667052 24134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:15.668406 24119 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:49:15.668582 24119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "ce83ea8f34ab416caab176440a6464f1"
format_stamp: "Formatted at 2026-08-06 04:48:52 on dist-test-slave-0b58"
server_key: "4a20842155ab60ae3192cd7ea840103c"
server_key_iv: "0de6bda86b0dcf0919175fca348a7ce6"
server_key_version: "encryptionkey@0"
I20260806 04:49:15.669534 24119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:49:15.690274 24119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:49:15.694043 24119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:49:15.694311 24119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:49:15.695226 24119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:49:15.696560 24119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:49:15.696679 24119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:15.696808 24119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:49:15.696904 24119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:15.730077 24119 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:33255
I20260806 04:49:15.730163 24247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:33255 every 8 connection(s)
I20260806 04:49:15.731469 24119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:49:15.741775 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 24119
I20260806 04:49:15.742532 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:36645
--local_ip_for_outbound_sockets=127.7.113.195
--tserver_master_addrs=127.7.113.254:42335
--webserver_port=40903
--webserver_interface=127.7.113.195
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 04:49:15 dist-test-slave-0b58 krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991755, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:49:15.750465 24117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:15.733944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:47943 (local address 127.7.113.254:42335)
0806 04:49:15.734122 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:15.734126 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:15.735175 (+ 1049us) server_negotiation.cc:407] Connection header received
0806 04:49:15.737027 (+ 1852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:15.737033 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:15.737124 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:15.737241 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:15.738664 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:15.739358 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:15.740942 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:15.741413 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:15.741549 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:15.745009 (+ 3460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:15.745015 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:15.745018 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:15.745048 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:15.747453 (+ 2405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:15.748168 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:15.748175 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:15.748178 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:15.748364 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:15.748789 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:15.748794 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:15.748798 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:15.749074 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:15.749235 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:15.749885 (+ 650us) server_negotiation.cc:299] Negotiation successful
0806 04:49:15.750116 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 04:49:15.751354 24250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:15.734344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:47943)
0806 04:49:15.735016 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:15.735058 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:15.736772 (+ 1714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:15.737476 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:15.737484 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:15.737952 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:49:15.738486 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:15.738503 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:15.739530 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:15.739534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:15.740800 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:15.740812 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:15.741645 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:15.741652 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:15.741929 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:15.742574 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:49:15.742621 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:49:15.744785 (+ 2164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:49:15.747600 (+ 2815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:15.747608 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:15.747623 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:15.748035 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:15.748475 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:15.748481 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:15.748484 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:15.748667 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:15.749211 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:49:15.749219 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:49:15.749535 (+ 316us) client_negotiation.cc:769] Sending connection context
0806 04:49:15.749789 (+ 254us) client_negotiation.cc:240] Negotiation successful
0806 04:49:15.750307 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":269,"threads_started":1}
I20260806 04:49:15.752789 24248 heartbeater.cc:347] Connected to a master server at 127.7.113.254:42335
I20260806 04:49:15.753108 24248 heartbeater.cc:464] Registering TS with master...
I20260806 04:49:15.753805 24248 heartbeater.cc:511] Master 127.7.113.254:42335 requested a full tablet report, sending...
I20260806 04:49:15.755282 23928 ts_manager.cc:194] Registered new tserver with Master: ce83ea8f34ab416caab176440a6464f1 (127.7.113.194:33255)
I20260806 04:49:15.756076 23928 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:47943
W20260806 04:49:16.074747 24251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:49:16.075040 24251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:49:16.075208 24251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:49:16.082630 24251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:49:16.082782 24251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:49:16.082952 24251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:49:16.092741 24251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:36645
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=40903
--tserver_master_addrs=127.7.113.254:42335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:49:16.094048 24251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:49:16.095403 24251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:49:16.108544 24259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:16.108580 24257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:16.108695 24256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:49:16.109270 24251 server_base.cc:1034] running on GCE node
I20260806 04:49:16.109912 24251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:49:16.110849 24251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:49:16.112077 24251 hybrid_clock.cc:648] HybridClock initialized: now 1785991756112034 us; error 29 us; skew 500 ppm
I20260806 04:49:16.112459 24251 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:49:16 dist-test-slave-0b58 krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991756, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:49:16.115751 24251 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:49:16.117177 24251 webserver.cc:460] Webserver started at http://127.7.113.195:40903/ using document root <none> and password file <none>
I20260806 04:49:16.117791 24251 fs_manager.cc:359] Metadata directory not provided
I20260806 04:49:16.117905 24251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:49:16.123111 24251 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 04:49:16.125718 24266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:16.126956 24251 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 04:49:16.127084 24251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "147dce0a455c4161bd7b6e6f5d230ddc"
format_stamp: "Formatted at 2026-08-06 04:48:53 on dist-test-slave-0b58"
server_key: "94a12c70c4d67d0fdaf9ae616e16ed74"
server_key_iv: "3e0811fddcb852837c073c0ee5f4941d"
server_key_version: "encryptionkey@0"
I20260806 04:49:16.127959 24251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:49:16.147611 24251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:49:16.151278 24251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:49:16.151481 24251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:49:16.152380 24251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:49:16.153568 24251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:49:16.153649 24251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:16.153724 24251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:49:16.153775 24251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:16.188349 24251 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:36645
I20260806 04:49:16.188446 24379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:36645 every 8 connection(s)
I20260806 04:49:16.189746 24251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:49:16.191505 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 24251
Aug 06 04:49:16 dist-test-slave-0b58 krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991756, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:49:16.209106 24117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.192583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38700 (local address 127.7.113.254:42335)
0806 04:49:16.192747 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:16.192753 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:16.193434 (+ 681us) server_negotiation.cc:407] Connection header received
0806 04:49:16.193787 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:16.193796 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:16.193904 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:16.193995 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:16.196706 (+ 2711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.197513 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.199116 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.199622 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.199727 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.203248 (+ 3521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:16.203252 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:16.203256 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:16.203283 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:16.206206 (+ 2923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:16.207052 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:16.207056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:16.207062 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:16.207266 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:16.207716 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:16.207720 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:16.207721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:16.207980 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:16.208208 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:16.208608 (+ 400us) server_negotiation.cc:299] Negotiation successful
0806 04:49:16.208793 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 04:49:16.211870 24383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.192583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:46739 (local address 127.7.113.254:42335)
0806 04:49:16.196579 (+ 3996us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:16.196583 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:16.196597 (+ 14us) server_negotiation.cc:407] Connection header received
0806 04:49:16.196656 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:16.196664 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:16.196727 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:16.196859 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:16.198414 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.199213 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.201280 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.201659 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.201760 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.205508 (+ 3748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:16.205513 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:16.205516 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:16.205555 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:16.208920 (+ 3365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:16.209664 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:16.209669 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:16.209673 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:16.209816 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:16.210248 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:16.210257 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:16.210259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:16.210590 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:16.210734 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:16.211408 (+ 674us) server_negotiation.cc:299] Negotiation successful
0806 04:49:16.211600 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":3909,"thread_start_us":3735,"threads_started":1}
I20260806 04:49:16.212831 24384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.193161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:46739)
0806 04:49:16.193979 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:16.194021 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:16.195676 (+ 1655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:16.197053 (+ 1377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:16.197060 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:16.197504 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:49:16.198232 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:16.198260 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.199347 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.199351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:16.201124 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:16.201141 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.201889 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.201898 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:16.202217 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.202826 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:49:16.202861 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:49:16.205282 (+ 2421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:49:16.209056 (+ 3774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:16.209064 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:16.209079 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:16.209539 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:16.209914 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:16.209937 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:16.209941 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:16.210118 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:16.210716 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:49:16.210723 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:49:16.211028 (+ 305us) client_negotiation.cc:769] Sending connection context
0806 04:49:16.211287 (+ 259us) client_negotiation.cc:240] Negotiation successful
0806 04:49:16.211735 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":349,"threads_started":1}
I20260806 04:49:16.214154 24380 heartbeater.cc:347] Connected to a master server at 127.7.113.254:42335
I20260806 04:49:16.214507 24380 heartbeater.cc:464] Registering TS with master...
I20260806 04:49:16.215234 24380 heartbeater.cc:511] Master 127.7.113.254:42335 requested a full tablet report, sending...
I20260806 04:49:16.216631 23928 ts_manager.cc:194] Registered new tserver with Master: 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645)
I20260806 04:49:16.217372 23928 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:46739
I20260806 04:49:16.224148 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:49:16.235477 24383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.225743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38702 (local address 127.7.113.254:42335)
0806 04:49:16.226408 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:16.226417 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:16.228181 (+ 1764us) server_negotiation.cc:407] Connection header received
0806 04:49:16.228310 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:16.228315 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:16.228502 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:16.228694 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:49:16.229390 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.230633 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.233187 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.233793 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.233938 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.234608 (+ 670us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:49:16.234938 (+ 330us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0806 04:49:16.235276 (+ 338us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38702: token expired
Metrics: {"server-negotiator.queue_time_us":172}
W20260806 04:49:16.235615 24383 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38702: token expired
W20260806 04:49:16.236513 23848 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.113.254:42335)
I20260806 04:49:16.251648 24383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.237214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38716 (local address 127.7.113.254:42335)
0806 04:49:16.237594 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:16.237598 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:16.237611 (+ 13us) server_negotiation.cc:407] Connection header received
0806 04:49:16.237649 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:16.237652 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:16.237703 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:16.237805 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:16.239331 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.240508 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.242129 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.242850 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.243002 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.245911 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:16.245920 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:16.245928 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:16.245974 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:16.249268 (+ 3294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:16.249919 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:16.249923 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:16.249925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:16.250037 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:16.250405 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:16.250409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:16.250410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:16.250707 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:16.250899 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:16.251189 (+ 290us) server_negotiation.cc:299] Negotiation successful
0806 04:49:16.251334 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272}
I20260806 04:49:16.255141 23928 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38716:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:49:16.262415 23928 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:49:16.305063 24394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.274948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38306 (local address 127.7.113.193:39317)
0806 04:49:16.295287 (+ 20339us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:16.295300 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:16.296085 (+ 785us) server_negotiation.cc:407] Connection header received
0806 04:49:16.296227 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:16.296239 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:16.296560 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:16.296785 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:49:16.298006 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.299838 (+ 1832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.302718 (+ 2880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.303794 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.303962 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.304206 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:16.304553 (+ 347us) server_negotiation.cc:299] Negotiation successful
0806 04:49:16.304731 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20115,"thread_start_us":19947,"threads_started":1}
I20260806 04:49:16.305167 24391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.274318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39317 (local address 127.0.0.1:38306)
0806 04:49:16.295735 (+ 21417us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:16.295760 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:16.295933 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:16.297206 (+ 1273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:16.297234 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:16.297270 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:49:16.297679 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:16.297693 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.299994 (+ 2301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.300000 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:16.302499 (+ 2499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:16.302514 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.304028 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.304035 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:16.304286 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.304352 (+ 66us) client_negotiation.cc:769] Sending connection context
0806 04:49:16.304497 (+ 145us) client_negotiation.cc:240] Negotiation successful
0806 04:49:16.304676 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21245,"mutex_wait_us":50,"thread_start_us":22417,"threads_started":1}
I20260806 04:49:16.305886 24393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.273973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:36645 (local address 127.0.0.1:55538)
0806 04:49:16.294518 (+ 20545us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:16.294555 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:16.294744 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:16.298502 (+ 3758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:16.298506 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:16.298527 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:49:16.298881 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:16.298894 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.300418 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.300423 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:16.302909 (+ 2486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:16.302923 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.304966 (+ 2043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.304971 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:16.305131 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.305227 (+ 96us) client_negotiation.cc:769] Sending connection context
0806 04:49:16.305309 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 04:49:16.305425 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20301,"mutex_wait_us":202,"thread_start_us":22560,"threads_started":1}
I20260806 04:49:16.306641 24390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.274799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:33255 (local address 127.0.0.1:53732)
0806 04:49:16.296794 (+ 21995us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:16.296817 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:16.297028 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:16.297722 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:16.297727 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:16.297756 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:49:16.298187 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:16.298201 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.300107 (+ 1906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.300115 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:16.302759 (+ 2644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:16.302774 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.304920 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.304928 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:16.305116 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.305764 (+ 648us) client_negotiation.cc:769] Sending connection context
0806 04:49:16.305893 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 04:49:16.306161 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21852,"mutex_wait_us":575,"thread_start_us":19312,"threads_started":1}
I20260806 04:49:16.307482 24395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.275317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53732 (local address 127.7.113.194:33255)
0806 04:49:16.296038 (+ 20721us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:16.296050 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:16.296922 (+ 872us) server_negotiation.cc:407] Connection header received
0806 04:49:16.297270 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:16.297281 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:16.297506 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:16.297721 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:49:16.298378 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.299924 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.302896 (+ 2972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.304385 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.304519 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.304734 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:16.306990 (+ 2256us) server_negotiation.cc:299] Negotiation successful
0806 04:49:16.307156 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20489,"thread_start_us":20819,"threads_started":1}
I20260806 04:49:16.307785 24392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.274281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55538 (local address 127.7.113.195:36645)
0806 04:49:16.297713 (+ 23432us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:16.297725 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:16.297759 (+ 34us) server_negotiation.cc:407] Connection header received
0806 04:49:16.297852 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:16.297859 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:16.298059 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:16.298242 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:49:16.299061 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.300281 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.303066 (+ 2785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.304513 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.304620 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.304820 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:16.306094 (+ 1274us) server_negotiation.cc:299] Negotiation successful
0806 04:49:16.306279 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23227,"thread_start_us":23036,"threads_started":1}
I20260806 04:49:16.309589 24050 tablet_service.cc:1467] Processing CreateTablet for tablet c82fc68605054891b23eccbbfa48d124 (DEFAULT_TABLE table=test-table [id=4b1c7ff6792b41c5854b013afbe996e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:49:16.311190 24050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c82fc68605054891b23eccbbfa48d124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:49:16.310989 24315 tablet_service.cc:1467] Processing CreateTablet for tablet c82fc68605054891b23eccbbfa48d124 (DEFAULT_TABLE table=test-table [id=4b1c7ff6792b41c5854b013afbe996e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:49:16.310894 24183 tablet_service.cc:1467] Processing CreateTablet for tablet c82fc68605054891b23eccbbfa48d124 (DEFAULT_TABLE table=test-table [id=4b1c7ff6792b41c5854b013afbe996e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:49:16.312093 24315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c82fc68605054891b23eccbbfa48d124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:49:16.312188 24183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c82fc68605054891b23eccbbfa48d124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:49:16.319806 24115 heartbeater.cc:503] Master 127.7.113.254:42335 was elected leader, sending a full tablet report...
I20260806 04:49:16.324811 24396 tablet_bootstrap.cc:492] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc: Bootstrap starting.
I20260806 04:49:16.327937 24396 tablet_bootstrap.cc:654] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc: Neither blocks nor log segments found. Creating new log.
I20260806 04:49:16.329182 24396 log.cc:824] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc: Log is configured to *not* fsync() on all Append() calls
I20260806 04:49:16.331833 24398 tablet_bootstrap.cc:492] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1: Bootstrap starting.
I20260806 04:49:16.332089 24397 tablet_bootstrap.cc:492] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696: Bootstrap starting.
I20260806 04:49:16.332295 24396 tablet_bootstrap.cc:492] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc: No bootstrap required, opened a new log
I20260806 04:49:16.332641 24396 ts_tablet_manager.cc:1397] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.002s
I20260806 04:49:16.334852 24397 tablet_bootstrap.cc:654] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696: Neither blocks nor log segments found. Creating new log.
I20260806 04:49:16.335387 24398 tablet_bootstrap.cc:654] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1: Neither blocks nor log segments found. Creating new log.
I20260806 04:49:16.335901 24397 log.cc:824] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696: Log is configured to *not* fsync() on all Append() calls
I20260806 04:49:16.336665 24398 log.cc:824] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1: Log is configured to *not* fsync() on all Append() calls
I20260806 04:49:16.339980 24398 tablet_bootstrap.cc:492] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1: No bootstrap required, opened a new log
I20260806 04:49:16.340277 24397 tablet_bootstrap.cc:492] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696: No bootstrap required, opened a new log
I20260806 04:49:16.340303 24398 ts_tablet_manager.cc:1397] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260806 04:49:16.340556 24397 ts_tablet_manager.cc:1397] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260806 04:49:16.343585 24396 raft_consensus.cc:348] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:16.343991 24396 raft_consensus.cc:374] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:49:16.344103 24396 raft_consensus.cc:729] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 147dce0a455c4161bd7b6e6f5d230ddc, State: Initialized, Role: FOLLOWER
I20260806 04:49:16.344743 24396 consensus_queue.cc:260] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:16.345825 24380 heartbeater.cc:503] Master 127.7.113.254:42335 was elected leader, sending a full tablet report...
I20260806 04:49:16.346415 24396 ts_tablet_manager.cc:1428] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc: Time spent starting tablet: real 0.014s user 0.012s sys 0.001s
I20260806 04:49:16.348508 24398 raft_consensus.cc:348] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:16.348946 24398 raft_consensus.cc:374] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:49:16.349069 24398 raft_consensus.cc:729] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce83ea8f34ab416caab176440a6464f1, State: Initialized, Role: FOLLOWER
I20260806 04:49:16.349658 24398 consensus_queue.cc:260] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:16.350795 24248 heartbeater.cc:503] Master 127.7.113.254:42335 was elected leader, sending a full tablet report...
I20260806 04:49:16.351388 24398 ts_tablet_manager.cc:1428] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1: Time spent starting tablet: real 0.011s user 0.008s sys 0.002s
I20260806 04:49:16.351596 24397 raft_consensus.cc:348] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:16.352002 24397 raft_consensus.cc:374] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:49:16.352121 24397 raft_consensus.cc:729] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaccf143f12c48b9aceced4a4d4e9696, State: Initialized, Role: FOLLOWER
I20260806 04:49:16.352644 24397 consensus_queue.cc:260] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:16.354298 24397 ts_tablet_manager.cc:1428] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696: Time spent starting tablet: real 0.014s user 0.005s sys 0.007s
W20260806 04:49:16.441372 24381 tablet.cc:2369] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:49:16.483489 24249 tablet.cc:2369] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:49:16.529845 24116 tablet.cc:2369] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:49:16.548545 24404 raft_consensus.cc:482] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:49:16.548854 24404 raft_consensus.cc:504] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:16.550593 24404 leader_election.cc:288] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645), aaccf143f12c48b9aceced4a4d4e9696 (127.7.113.193:39317)
I20260806 04:49:16.557279 24392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.551056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:48267 (local address 127.7.113.195:36645)
0806 04:49:16.551265 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:16.551274 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:16.551965 (+ 691us) server_negotiation.cc:407] Connection header received
0806 04:49:16.552206 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:16.552210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:16.552315 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:16.552418 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:49:16.552975 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.553704 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.555522 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.556359 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.556533 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.556610 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:16.556906 (+ 296us) server_negotiation.cc:299] Negotiation successful
0806 04:49:16.557028 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 04:49:16.557451 24406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.551056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:36645 (local address 127.7.113.194:48267)
0806 04:49:16.551850 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:16.551865 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:16.552033 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:16.552435 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:16.552439 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:16.552477 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:49:16.552829 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:16.552838 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.553841 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.553847 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:16.555367 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:16.555379 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.556563 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.556570 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:16.556747 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.556771 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 04:49:16.556882 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 04:49:16.557003 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"mutex_wait_us":34,"thread_start_us":439,"threads_started":1}
I20260806 04:49:16.557581 24394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.551150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:40557 (local address 127.7.113.193:39317)
0806 04:49:16.551380 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:16.551388 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:16.552051 (+ 663us) server_negotiation.cc:407] Connection header received
0806 04:49:16.552290 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:16.552298 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:16.552378 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:16.552479 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:49:16.553151 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.553845 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.555610 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.556460 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.556633 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.556713 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:16.557204 (+ 491us) server_negotiation.cc:299] Negotiation successful
0806 04:49:16.557330 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 04:49:16.557770 24407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.551094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39317 (local address 127.7.113.194:40557)
0806 04:49:16.551939 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:16.551957 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:16.552120 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:16.552492 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:16.552496 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:16.552519 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:49:16.552979 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:16.552988 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.553977 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.553982 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:16.555450 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:16.555462 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.556685 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.556691 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:16.556915 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.556938 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 04:49:16.557163 (+ 225us) client_negotiation.cc:240] Negotiation successful
0806 04:49:16.557281 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":748,"mutex_wait_us":87,"thread_start_us":506,"threads_started":1}
I20260806 04:49:16.558638 24335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82fc68605054891b23eccbbfa48d124" candidate_uuid: "ce83ea8f34ab416caab176440a6464f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" is_pre_election: true
I20260806 04:49:16.558845 24070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82fc68605054891b23eccbbfa48d124" candidate_uuid: "ce83ea8f34ab416caab176440a6464f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaccf143f12c48b9aceced4a4d4e9696" is_pre_election: true
I20260806 04:49:16.559141 24335 raft_consensus.cc:2454] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce83ea8f34ab416caab176440a6464f1 in term 0.
I20260806 04:49:16.559396 24070 raft_consensus.cc:2454] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce83ea8f34ab416caab176440a6464f1 in term 0.
I20260806 04:49:16.559857 24137 leader_election.cc:302] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 147dce0a455c4161bd7b6e6f5d230ddc, ce83ea8f34ab416caab176440a6464f1; no voters:
I20260806 04:49:16.560299 24404 raft_consensus.cc:2781] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:49:16.560464 24404 raft_consensus.cc:482] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:49:16.560572 24404 raft_consensus.cc:3037] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:49:16.562752 24404 raft_consensus.cc:504] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:16.563395 24404 leader_election.cc:288] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [CANDIDATE]: Term 1 election: Requested vote from peers 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645), aaccf143f12c48b9aceced4a4d4e9696 (127.7.113.193:39317)
I20260806 04:49:16.563756 24335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82fc68605054891b23eccbbfa48d124" candidate_uuid: "ce83ea8f34ab416caab176440a6464f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "147dce0a455c4161bd7b6e6f5d230ddc"
I20260806 04:49:16.563970 24335 raft_consensus.cc:3037] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:49:16.564018 24070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82fc68605054891b23eccbbfa48d124" candidate_uuid: "ce83ea8f34ab416caab176440a6464f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaccf143f12c48b9aceced4a4d4e9696"
I20260806 04:49:16.564213 24070 raft_consensus.cc:3037] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:49:16.567207 24335 raft_consensus.cc:2454] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce83ea8f34ab416caab176440a6464f1 in term 1.
I20260806 04:49:16.567351 24070 raft_consensus.cc:2454] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce83ea8f34ab416caab176440a6464f1 in term 1.
I20260806 04:49:16.567615 24137 leader_election.cc:302] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 147dce0a455c4161bd7b6e6f5d230ddc, ce83ea8f34ab416caab176440a6464f1; no voters:
I20260806 04:49:16.567900 24404 raft_consensus.cc:2781] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:49:16.568429 24404 raft_consensus.cc:686] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [term 1 LEADER]: Becoming Leader. State: Replica: ce83ea8f34ab416caab176440a6464f1, State: Running, Role: LEADER
I20260806 04:49:16.568897 24404 consensus_queue.cc:237] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:16.573326 23927 catalog_manager.cc:5495] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce83ea8f34ab416caab176440a6464f1 (127.7.113.194). New cstate: current_term: 1 leader_uuid: "ce83ea8f34ab416caab176440a6464f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } health_report { overall_health: HEALTHY } } }
I20260806 04:49:16.601476 24395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.596376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53748 (local address 127.7.113.194:33255)
0806 04:49:16.596567 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:16.596572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:16.596588 (+ 16us) server_negotiation.cc:407] Connection header received
0806 04:49:16.596771 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:16.596775 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:16.596867 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:16.596992 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:49:16.597317 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.598013 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.599471 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.599869 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.599967 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.600465 (+ 498us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:49:16.600949 (+ 484us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:49:16.601056 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:16.601146 (+ 90us) server_negotiation.cc:299] Negotiation successful
0806 04:49:16.601209 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 04:49:16.609655 24070 raft_consensus.cc:1261] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Refusing update from remote peer ce83ea8f34ab416caab176440a6464f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:49:16.609654 24335 raft_consensus.cc:1261] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc [term 1 FOLLOWER]: Refusing update from remote peer ce83ea8f34ab416caab176440a6464f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:49:16.610716 24408 consensus_queue.cc:1035] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:49:16.611074 24404 consensus_queue.cc:1035] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:49:16.622812 24410 mvcc.cc:205] Tried to move back new op lower bound from 7315422235062157312 to 7315422234909908992. Current Snapshot: MvccSnapshot[applied={T|T < 7315422235062157312}]
I20260806 04:49:16.628455 24412 mvcc.cc:205] Tried to move back new op lower bound from 7315422235062157312 to 7315422234909908992. Current Snapshot: MvccSnapshot[applied={T|T < 7315422235062157312}]
I20260806 04:49:16.636672 23927 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:49:16.636960 23927 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:49:16.640415 23927 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Sending DeleteTablet for 3 replicas of tablet c82fc68605054891b23eccbbfa48d124
I20260806 04:49:16.641585 24050 tablet_service.cc:1514] Processing DeleteTablet for tablet c82fc68605054891b23eccbbfa48d124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:49:16 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:38306
I20260806 04:49:16.641603 24315 tablet_service.cc:1514] Processing DeleteTablet for tablet c82fc68605054891b23eccbbfa48d124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:49:16 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:55538
I20260806 04:49:16.641616 24183 tablet_service.cc:1514] Processing DeleteTablet for tablet c82fc68605054891b23eccbbfa48d124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:49:16 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:53732
I20260806 04:49:16.647573 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 23966
I20260806 04:49:16.662096 24420 tablet_replica.cc:330] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc: stopping tablet replica
I20260806 04:49:16.662709 24420 raft_consensus.cc:2229] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:49:16.663380 24420 raft_consensus.cc:2258] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:49:16.665858 24420 ts_tablet_manager.cc:1905] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:49:16.669981 24394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.648904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38322 (local address 127.7.113.193:39317)
0806 04:49:16.649143 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:16.649151 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:16.649173 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:49:16.649287 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:16.649294 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:16.649393 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:16.649503 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:16.651829 (+ 2326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.653437 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.655972 (+ 2535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.656938 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.657067 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.661997 (+ 4930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:16.662013 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:16.662031 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:16.662083 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:16.666253 (+ 4170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:16.667195 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:16.667203 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:16.667208 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:16.667401 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:16.667939 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:16.667944 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:16.667948 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:16.668430 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:16.668710 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:16.669322 (+ 612us) server_negotiation.cc:299] Negotiation successful
0806 04:49:16.669563 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 04:49:16.671598 24110 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:49:16.674273 24420 ts_tablet_manager.cc:1918] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:49:16.674530 24420 log.cc:1196] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/c82fc68605054891b23eccbbfa48d124
I20260806 04:49:16.675262 24420 ts_tablet_manager.cc:1939] T c82fc68605054891b23eccbbfa48d124 P 147dce0a455c4161bd7b6e6f5d230ddc: Deleting consensus metadata
I20260806 04:49:16.678468 23914 catalog_manager.cc:4841] TS 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645): tablet c82fc68605054891b23eccbbfa48d124 (table test-table [id=4b1c7ff6792b41c5854b013afbe996e6]) successfully deleted
I20260806 04:49:16.679625 24422 tablet_replica.cc:330] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1: stopping tablet replica
I20260806 04:49:16.680227 24422 raft_consensus.cc:2229] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:49:16.681332 24422 raft_consensus.cc:2258] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:49:16.683622 24422 ts_tablet_manager.cc:1905] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:49:16.688975 24422 ts_tablet_manager.cc:1918] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:49:16.689160 24422 log.cc:1196] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/c82fc68605054891b23eccbbfa48d124
I20260806 04:49:16.689628 24422 ts_tablet_manager.cc:1939] T c82fc68605054891b23eccbbfa48d124 P ce83ea8f34ab416caab176440a6464f1: Deleting consensus metadata
I20260806 04:49:16.691074 23912 catalog_manager.cc:4841] TS ce83ea8f34ab416caab176440a6464f1 (127.7.113.194:33255): tablet c82fc68605054891b23eccbbfa48d124 (table test-table [id=4b1c7ff6792b41c5854b013afbe996e6]) successfully deleted
I20260806 04:49:16.805616 24421 tablet_replica.cc:330] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696: stopping tablet replica
I20260806 04:49:16.806123 24421 raft_consensus.cc:2229] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:49:16.806154 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 23966
W20260806 04:49:16.825881 23915 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.113.193:39317 (error 108)
I20260806 04:49:16.826061 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 24119
I20260806 04:49:16.841032 24425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.827759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39317 (local address 127.0.0.1:38336)
0806 04:49:16.840756 (+ 12997us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:16.840880 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12851,"thread_start_us":12761,"threads_started":1}
W20260806 04:49:16.841430 23915 catalog_manager.cc:4584] TS aaccf143f12c48b9aceced4a4d4e9696 (127.7.113.193:39317): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c82fc68605054891b23eccbbfa48d124: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39317: connect: Connection refused (error 111)
I20260806 04:49:16.848963 24395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.827157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53760 (local address 127.7.113.194:33255)
0806 04:49:16.827339 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:16.827345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:16.827364 (+ 19us) server_negotiation.cc:407] Connection header received
0806 04:49:16.827605 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:16.827611 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:16.827695 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:16.827803 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:16.829892 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.831162 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.833322 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.834021 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.834120 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.842448 (+ 8328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:16.842466 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:16.842485 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:16.842530 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:16.846169 (+ 3639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:16.846991 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:16.846999 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:16.847001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:16.847142 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:16.847551 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:16.847554 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:16.847556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:16.847916 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:16.848139 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:16.848493 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 04:49:16.848651 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 04:49:16.849673 24243 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:49:16.895254 24425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.894716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39317 (local address 127.0.0.1:38350)
0806 04:49:16.894963 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:16.895077 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260806 04:49:16.896410 24425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.895941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39317 (local address 127.0.0.1:38356)
0806 04:49:16.896100 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:16.896199 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 04:49:16.956939 24425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.956401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39317 (local address 127.0.0.1:38364)
0806 04:49:16.956628 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:16.956741 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260806 04:49:16.958032 24425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.957621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39317 (local address 127.0.0.1:38370)
0806 04:49:16.957787 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:16.957876 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 04:49:16.964196 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 24119
I20260806 04:49:16.985972 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 24251
I20260806 04:49:16.999444 24392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:16.986733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55550 (local address 127.7.113.195:36645)
0806 04:49:16.986922 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:16.986930 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:16.986951 (+ 21us) server_negotiation.cc:407] Connection header received
0806 04:49:16.987163 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:16.987169 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:16.987244 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:16.987389 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:16.988779 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.989508 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.990789 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:16.991176 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:16.991311 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:16.994106 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:16.994119 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:16.994134 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:16.994165 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:16.996639 (+ 2474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:16.997394 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:16.997401 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:16.997403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:16.997567 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:16.997953 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:16.997959 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:16.997962 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:16.998292 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:16.998605 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:16.998896 (+ 291us) server_negotiation.cc:299] Negotiation successful
0806 04:49:16.999115 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 04:49:17.000069 24375 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:49:17.038655 24425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:17.038174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39317 (local address 127.0.0.1:38374)
0806 04:49:17.038410 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:17.038502 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260806 04:49:17.039747 24425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:17.039345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:39317 (local address 127.0.0.1:38378)
0806 04:49:17.039547 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:17.039615 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:39317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260806 04:49:17.089545 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 24251
I20260806 04:49:17.109990 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 23895
I20260806 04:49:17.111148 23959 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:49:17.224691 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 23895
I20260806 04:49:37.246079 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42335
--webserver_interface=127.7.113.254
--webserver_port=38033
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:42335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:49:37.576018 24429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:49:37.576365 24429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:49:37.576539 24429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:49:37.583511 24429 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 04:49:37.583652 24429 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 04:49:37.583747 24429 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 04:49:37.583827 24429 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:49:37.583914 24429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:49:37.584017 24429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:49:37.584086 24429 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:49:37.584177 24429 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:49:37.593938 24429 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:42335
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=38033
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:49:37.595184 24429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:49:37.596601 24429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:49:37.608723 24434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:37.608767 24435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:37.609292 24437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:49:37.609364 24429 server_base.cc:1034] running on GCE node
I20260806 04:49:37.610162 24429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:49:37.611565 24429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:49:37.612818 24429 hybrid_clock.cc:648] HybridClock initialized: now 1785991777612747 us; error 46 us; skew 500 ppm
I20260806 04:49:37.613238 24429 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:49:37 dist-test-slave-0b58 krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991777, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:49:37.621057 24429 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:49:37.622568 24429 webserver.cc:460] Webserver started at http://127.7.113.254:38033/ using document root <none> and password file <none>
I20260806 04:49:37.623376 24429 fs_manager.cc:359] Metadata directory not provided
I20260806 04:49:37.623514 24429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:49:37.629086 24429 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 04:49:37.632385 24444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:37.634137 24429 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 04:49:37.634349 24429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "59c440f4b7cf4328a241e648c803b3fe"
format_stamp: "Formatted at 2026-08-06 04:48:51 on dist-test-slave-0b58"
server_key: "b608a369d5a95f480508b824774c90ce"
server_key_iv: "19177ab49d71e4f6fb11e258e429cf2f"
server_key_version: "encryptionkey@0"
I20260806 04:49:37.635842 24429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:49:37.667760 24429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:49:37.673470 24429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:49:37.673817 24429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:49:37.695983 24429 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:42335
I20260806 04:49:37.696004 24495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:42335 every 8 connection(s)
I20260806 04:49:37.697505 24429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:49:37.704850 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 24429
I20260806 04:49:37.705767 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:39317
--local_ip_for_outbound_sockets=127.7.113.193
--tserver_master_addrs=127.7.113.254:42335
--webserver_port=46133
--webserver_interface=127.7.113.193
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:49:37.707304 24496 sys_catalog.cc:263] Verifying existing consensus state
I20260806 04:49:37.712641 24496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Bootstrap starting.
I20260806 04:49:37.743592 24496 log.cc:824] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Log is configured to *not* fsync() on all Append() calls
I20260806 04:49:37.759137 24496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 04:49:37.759697 24496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Bootstrap complete.
I20260806 04:49:37.768793 24496 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } }
I20260806 04:49:37.769618 24496 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59c440f4b7cf4328a241e648c803b3fe, State: Initialized, Role: FOLLOWER
I20260806 04:49:37.770226 24496 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } }
I20260806 04:49:37.770496 24496 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:49:37.770640 24496 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:49:37.770828 24496 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 2 FOLLOWER]: Advancing to term 3
I20260806 04:49:37.774588 24496 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } }
I20260806 04:49:37.775089 24496 leader_election.cc:302] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59c440f4b7cf4328a241e648c803b3fe; no voters:
I20260806 04:49:37.775771 24496 leader_election.cc:288] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 04:49:37.775921 24500 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 3 FOLLOWER]: Leader election won for term 3
I20260806 04:49:37.777189 24500 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [term 3 LEADER]: Becoming Leader. State: Replica: 59c440f4b7cf4328a241e648c803b3fe, State: Running, Role: LEADER
I20260806 04:49:37.777776 24500 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } }
I20260806 04:49:37.778044 24496 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:49:37.780325 24502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59c440f4b7cf4328a241e648c803b3fe. Latest consensus state: current_term: 3 leader_uuid: "59c440f4b7cf4328a241e648c803b3fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } } }
I20260806 04:49:37.780704 24502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: This master's current role is: LEADER
I20260806 04:49:37.781242 24501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "59c440f4b7cf4328a241e648c803b3fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c440f4b7cf4328a241e648c803b3fe" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42335 } } }
I20260806 04:49:37.781535 24501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe [sys.catalog]: This master's current role is: LEADER
I20260806 04:49:37.791718 24506 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:49:37.802073 24506 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:49:37.804076 24506 catalog_manager.cc:1259] Loaded cluster ID: 152d0872dbac444b9355a655d959ec72
I20260806 04:49:37.804289 24506 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:49:37.809677 24506 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:49:37.811879 24506 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Loaded TSK: 0
I20260806 04:49:37.812135 24506 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 59c440f4b7cf4328a241e648c803b3fe: Loaded TSK: 1
F20260806 04:49:37.813534 24506 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f409a4119ad google::LogMessage::Fail() at ??:0
@ 0x7f409a41488a google::LogMessage::SendToLog() at ??:0
@ 0x7f409a4114de google::LogMessage::Flush() at ??:0
@ 0x7f409a412a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f409e1757d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f409e16473e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f40afe401c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f40afe3f783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f40afecb2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f40afecb0c4 std::_Function_handler<>::_M_invoke() at ??:0
I20260806 04:49:37.863400 24522 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f40aff155e9 std::function<>::operator()() at ??:0
@ 0x7f40afe43cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f40afe41c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f40afec9610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f40afec9439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f409d05d345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f409d06091c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f409d060799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f409d03beaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f40a03156db start_thread at ??:0
@ 0x7f40992ab61f clone at ??:0
W20260806 04:49:38.125499 24498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:49:38.125977 24498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:49:38.126260 24498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:49:38.133594 24498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:49:38.133695 24498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:49:38.133872 24498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:49:38.143596 24498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:39317
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=46133
--tserver_master_addrs=127.7.113.254:42335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:49:38.144876 24498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:49:38.146206 24498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:49:38.158785 24545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:38.158831 24546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:38.158910 24548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:49:38.160029 24498 server_base.cc:1034] running on GCE node
I20260806 04:49:38.160629 24498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:49:38.161509 24498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:49:38.162705 24498 hybrid_clock.cc:648] HybridClock initialized: now 1785991778162644 us; error 54 us; skew 500 ppm
I20260806 04:49:38.163013 24498 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:49:38 dist-test-slave-0b58 krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991778, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:49:38.166196 24498 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:49:38.167637 24498 webserver.cc:460] Webserver started at http://127.7.113.193:46133/ using document root <none> and password file <none>
I20260806 04:49:38.168365 24498 fs_manager.cc:359] Metadata directory not provided
I20260806 04:49:38.168499 24498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:49:38.173699 24498 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:49:38.176542 24555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:38.177832 24498 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:49:38.177995 24498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "aaccf143f12c48b9aceced4a4d4e9696"
format_stamp: "Formatted at 2026-08-06 04:48:52 on dist-test-slave-0b58"
server_key: "e7456ea079b646a77ba9eb56fb3d8013"
server_key_iv: "93145e93eb3ab3b8e2c75fdefbae6d1f"
server_key_version: "encryptionkey@0"
I20260806 04:49:38.178972 24498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:49:38.197620 24498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:49:38.201906 24498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:49:38.202214 24498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:49:38.203222 24498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:49:38.205112 24562 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260806 04:49:38.210700 24498 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 04:49:38.210812 24498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.001s
I20260806 04:49:38.210980 24498 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 04:49:38.214299 24498 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 04:49:38.214380 24498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.002s
I20260806 04:49:38.214784 24562 tablet_bootstrap.cc:492] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696: Bootstrap starting.
I20260806 04:49:38.243795 24562 log.cc:824] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696: Log is configured to *not* fsync() on all Append() calls
I20260806 04:49:38.258333 24562 tablet_bootstrap.cc:492] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 04:49:38.258749 24498 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:39317
I20260806 04:49:38.258796 24671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:39317 every 8 connection(s)
I20260806 04:49:38.259057 24562 tablet_bootstrap.cc:492] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696: Bootstrap complete.
I20260806 04:49:38.259972 24498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:49:38.260574 24562 ts_tablet_manager.cc:1397] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696: Time spent bootstrapping tablet: real 0.046s user 0.025s sys 0.019s
I20260806 04:49:38.265470 24674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:38.263243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:40001)
0806 04:49:38.264242 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:38.264586 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":732,"thread_start_us":449,"threads_started":1}
W20260806 04:49:38.266064 24672 heartbeater.cc:644] Failed to heartbeat to 127.7.113.254:42335 (0 consecutive failures): Network error: Failed to ping master at 127.7.113.254:42335: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
I20260806 04:49:38.266896 24674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:38.266559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:49107)
0806 04:49:38.266714 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:38.266792 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 04:49:38.267125 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 24498
I20260806 04:49:38.267848 24674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:38.267471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:49211)
0806 04:49:38.267632 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:38.267724 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 04:49:38.267908 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:33255
--local_ip_for_outbound_sockets=127.7.113.194
--tserver_master_addrs=127.7.113.254:42335
--webserver_port=36143
--webserver_interface=127.7.113.194
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:49:38.268128 24672 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 04:49:38.269235 24562 raft_consensus.cc:348] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:38.270664 24562 raft_consensus.cc:729] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaccf143f12c48b9aceced4a4d4e9696, State: Initialized, Role: FOLLOWER
I20260806 04:49:38.271317 24562 consensus_queue.cc:260] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:38.272800 24674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:38.272490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:51883)
0806 04:49:38.272631 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:38.272703 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 04:49:38.273046 24562 ts_tablet_manager.cc:1428] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696: Time spent starting tablet: real 0.012s user 0.010s sys 0.001s
I20260806 04:49:38.273902 24674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:38.273590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:57031)
0806 04:49:38.273724 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:38.273792 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 04:49:38.613077 24676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:49:38.613346 24676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:49:38.613440 24676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:49:38.620880 24676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:49:38.620981 24676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:49:38.621136 24676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:49:38.630728 24676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:33255
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=36143
--tserver_master_addrs=127.7.113.254:42335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:49:38.631901 24676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:49:38.633203 24676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:49:38.646080 24681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:38.646080 24682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:38.646770 24684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:49:38.647184 24676 server_base.cc:1034] running on GCE node
I20260806 04:49:38.647893 24676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:49:38.648909 24676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:49:38.650153 24676 hybrid_clock.cc:648] HybridClock initialized: now 1785991778650109 us; error 55 us; skew 500 ppm
I20260806 04:49:38.650503 24676 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:49:38 dist-test-slave-0b58 krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991778, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:49:38.653673 24676 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:49:38.655068 24676 webserver.cc:460] Webserver started at http://127.7.113.194:36143/ using document root <none> and password file <none>
I20260806 04:49:38.655756 24676 fs_manager.cc:359] Metadata directory not provided
I20260806 04:49:38.655920 24676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:49:38.661190 24676 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:49:38.663857 24691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:38.665126 24676 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:49:38.665328 24676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "ce83ea8f34ab416caab176440a6464f1"
format_stamp: "Formatted at 2026-08-06 04:48:52 on dist-test-slave-0b58"
server_key: "4a20842155ab60ae3192cd7ea840103c"
server_key_iv: "0de6bda86b0dcf0919175fca348a7ce6"
server_key_version: "encryptionkey@0"
I20260806 04:49:38.666334 24676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:49:38.694767 24676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:49:38.698627 24676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:49:38.698894 24676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:49:38.699817 24676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:49:38.701177 24676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:49:38.701310 24676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:38.701452 24676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:49:38.701541 24676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:38.734745 24676 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:33255
I20260806 04:49:38.734833 24805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:33255 every 8 connection(s)
I20260806 04:49:38.736188 24676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:49:38.741008 24808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:38.739176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:42947)
0806 04:49:38.739883 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:38.740119 (+ 236us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":270,"threads_started":1}
W20260806 04:49:38.741655 24806 heartbeater.cc:644] Failed to heartbeat to 127.7.113.254:42335 (0 consecutive failures): Network error: Failed to ping master at 127.7.113.254:42335: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
I20260806 04:49:38.742563 24808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:38.742246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:52879)
0806 04:49:38.742387 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:38.742454 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 04:49:38.743448 24808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:38.743087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:59897)
0806 04:49:38.743206 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:38.743288 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 04:49:38.743772 24806 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 04:49:38.743894 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 24676
I20260806 04:49:38.744620 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:36645
--local_ip_for_outbound_sockets=127.7.113.195
--tserver_master_addrs=127.7.113.254:42335
--webserver_port=40903
--webserver_interface=127.7.113.195
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:45735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:49:39.090037 24809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:49:39.090298 24809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:49:39.090466 24809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:49:39.097453 24809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:49:39.097550 24809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:49:39.097747 24809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:49:39.107051 24809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:45735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:36645
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=40903
--tserver_master_addrs=127.7.113.254:42335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:49:39.108294 24809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:49:39.109582 24809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:49:39.122551 24814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:39.122586 24815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:39.122499 24817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:49:39.123497 24809 server_base.cc:1034] running on GCE node
I20260806 04:49:39.124068 24809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:49:39.125015 24809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:49:39.126240 24809 hybrid_clock.cc:648] HybridClock initialized: now 1785991779126195 us; error 57 us; skew 500 ppm
I20260806 04:49:39.126546 24809 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:49:39 dist-test-slave-0b58 krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991779, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:49:39.129942 24809 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:49:39.131389 24809 webserver.cc:460] Webserver started at http://127.7.113.195:40903/ using document root <none> and password file <none>
I20260806 04:49:39.132053 24809 fs_manager.cc:359] Metadata directory not provided
I20260806 04:49:39.132201 24809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:49:39.137328 24809 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:49:39.139832 24824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:39.141085 24809 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:49:39.141259 24809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "147dce0a455c4161bd7b6e6f5d230ddc"
format_stamp: "Formatted at 2026-08-06 04:48:53 on dist-test-slave-0b58"
server_key: "94a12c70c4d67d0fdaf9ae616e16ed74"
server_key_iv: "3e0811fddcb852837c073c0ee5f4941d"
server_key_version: "encryptionkey@0"
I20260806 04:49:39.142231 24809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:49:39.167266 24809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:49:39.171700 24809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:49:39.171993 24809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:49:39.173000 24809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:49:39.174307 24809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:49:39.174433 24809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:39.174572 24809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:49:39.174695 24809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:39.207926 24809 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:36645
I20260806 04:49:39.208011 24936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:36645 every 8 connection(s)
I20260806 04:49:39.209448 24809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:49:39.213508 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 24809
I20260806 04:49:39.214419 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:39.212308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:47483)
0806 04:49:39.213060 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:39.213360 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":269,"threads_started":1}
W20260806 04:49:39.215197 24937 heartbeater.cc:644] Failed to heartbeat to 127.7.113.254:42335 (0 consecutive failures): Network error: Failed to ping master at 127.7.113.254:42335: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
I20260806 04:49:39.216079 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:39.215682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:43007)
0806 04:49:39.215874 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:39.215958 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 04:49:39.216944 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:39.216617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:39415)
0806 04:49:39.216755 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:39.216833 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 04:49:39.217166 24937 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 04:49:39.275456 24941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:39.274740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:48129)
0806 04:49:39.275175 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:39.275264 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":207,"threads_started":1}
I20260806 04:49:39.745020 24942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:39.744326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:52511)
0806 04:49:39.744725 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:39.744805 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":191,"threads_started":1}
I20260806 04:49:40.019459 24943 raft_consensus.cc:482] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:49:40.019761 24943 raft_consensus.cc:504] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:40.021517 24943 leader_election.cc:288] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645), ce83ea8f34ab416caab176440a6464f1 (127.7.113.194:33255)
Aug 06 04:49:40 dist-test-slave-0b58 krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991778, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
Aug 06 04:49:40 dist-test-slave-0b58 krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991778, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:49:40.044193 24947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:40.022288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:41581 (local address 127.7.113.194:33255)
0806 04:49:40.024327 (+ 2039us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:40.024342 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:40.024692 (+ 350us) server_negotiation.cc:407] Connection header received
0806 04:49:40.026286 (+ 1594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:40.026294 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:40.026570 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:40.026869 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:40.028133 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:40.029325 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:40.030980 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:40.031567 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:40.031758 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:40.035997 (+ 4239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:40.036016 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:40.036030 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:40.036104 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:40.039832 (+ 3728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:40.040863 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:40.040872 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:40.040878 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:40.041066 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:40.041622 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:40.041626 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:40.041629 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:40.042227 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:40.042408 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:40.043401 (+ 993us) server_negotiation.cc:299] Negotiation successful
0806 04:49:40.043790 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1801,"thread_start_us":1585,"threads_started":1}
I20260806 04:49:40.044186 24944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:40.021721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:36645 (local address 127.7.113.193:37143)
0806 04:49:40.022343 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:40.022378 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:40.023001 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:40.026503 (+ 3502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:40.026513 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:40.027296 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:49:40.027906 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:40.027924 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:40.029494 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:40.029498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:40.030848 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:40.030861 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:40.031829 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:40.031839 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:40.032073 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:40.032868 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:49:40.032899 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:49:40.035510 (+ 2611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:49:40.039898 (+ 4388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:40.039927 (+ 29us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:40.039943 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:40.040723 (+ 780us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:40.041224 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:40.041228 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:40.041230 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:40.041500 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:40.042365 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:49:40.042373 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:49:40.042845 (+ 472us) client_negotiation.cc:769] Sending connection context
0806 04:49:40.043148 (+ 303us) client_negotiation.cc:240] Negotiation successful
0806 04:49:40.043649 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"mutex_wait_us":230,"spinlock_wait_cycles":15616,"thread_start_us":2510,"threads_started":1}
I20260806 04:49:40.044206 24946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:40.022189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:37143 (local address 127.7.113.195:36645)
0806 04:49:40.023909 (+ 1720us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:40.023922 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:40.023966 (+ 44us) server_negotiation.cc:407] Connection header received
0806 04:49:40.025655 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:40.025663 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:40.026022 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:40.026368 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:40.028103 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:40.029290 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:40.030990 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:40.031571 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:40.031747 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:40.035821 (+ 4074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:40.035832 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:40.035847 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:40.035907 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:40.039742 (+ 3835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:40.040869 (+ 1127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:40.040876 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:40.040881 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:40.041066 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:40.041613 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:40.041617 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:40.041620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:40.042227 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:40.042402 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:40.043385 (+ 983us) server_negotiation.cc:299] Negotiation successful
0806 04:49:40.043780 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1440,"thread_start_us":1297,"threads_started":1}
I20260806 04:49:40.044203 24945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:40.021731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:33255 (local address 127.7.113.193:41581)
0806 04:49:40.024570 (+ 2839us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:40.024589 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:40.024713 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:40.026830 (+ 2117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:40.026835 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:40.027465 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:49:40.027955 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:40.027968 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:40.029496 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:40.029500 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:40.030841 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:40.030854 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:40.031782 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:40.031788 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:40.032076 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:40.032935 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:49:40.032952 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:49:40.035748 (+ 2796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:49:40.039960 (+ 4212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:40.039964 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:40.039967 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:40.040723 (+ 756us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:40.041196 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:40.041203 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:40.041209 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:40.041500 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:40.042365 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:49:40.042373 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:49:40.042845 (+ 472us) client_negotiation.cc:769] Sending connection context
0806 04:49:40.043148 (+ 303us) client_negotiation.cc:240] Negotiation successful
0806 04:49:40.043772 (+ 624us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2722,"mutex_wait_us":350,"spinlock_wait_cycles":7808,"thread_start_us":675,"threads_started":1}
W20260806 04:49:40.047607 24558 leader_election.cc:341] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645): Not found: Tablet not found: c82fc68605054891b23eccbbfa48d124
W20260806 04:49:40.048105 24556 leader_election.cc:341] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce83ea8f34ab416caab176440a6464f1 (127.7.113.194:33255): Not found: Tablet not found: c82fc68605054891b23eccbbfa48d124
I20260806 04:49:40.048219 24556 leader_election.cc:302] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaccf143f12c48b9aceced4a4d4e9696; no voters: 147dce0a455c4161bd7b6e6f5d230ddc, ce83ea8f34ab416caab176440a6464f1
I20260806 04:49:40.048744 24943 raft_consensus.cc:2726] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 04:49:40.218822 24948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:40.217674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:44305)
0806 04:49:40.218235 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:40.218458 (+ 223us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":240,"threads_started":1}
I20260806 04:49:40.276911 24944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:40.276445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:39901)
0806 04:49:40.276618 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:40.276747 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 04:49:40.746578 24949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:40.745827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:40663)
0806 04:49:40.746345 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:40.746432 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":225,"threads_started":1}
I20260806 04:49:41.220496 24950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:41.219701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:60173)
0806 04:49:41.220209 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:41.220343 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":317,"threads_started":1}
I20260806 04:49:41.278563 24951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:41.277755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:52539)
0806 04:49:41.278295 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:41.278375 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":233,"threads_started":1}
I20260806 04:49:41.748029 24952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:41.747345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:53795)
0806 04:49:41.747782 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:41.747863 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":227,"threads_started":1}
I20260806 04:49:42.222074 24953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:42.221357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:59713)
0806 04:49:42.221829 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:42.221910 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":234,"threads_started":1}
I20260806 04:49:42.251364 24954 raft_consensus.cc:482] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:49:42.251566 24954 raft_consensus.cc:504] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:42.252300 24954 leader_election.cc:288] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645), ce83ea8f34ab416caab176440a6464f1 (127.7.113.194:33255)
W20260806 04:49:42.253237 24558 leader_election.cc:341] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645): Not found: Tablet not found: c82fc68605054891b23eccbbfa48d124
W20260806 04:49:42.253383 24556 leader_election.cc:341] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce83ea8f34ab416caab176440a6464f1 (127.7.113.194:33255): Not found: Tablet not found: c82fc68605054891b23eccbbfa48d124
I20260806 04:49:42.253551 24556 leader_election.cc:302] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaccf143f12c48b9aceced4a4d4e9696; no voters: 147dce0a455c4161bd7b6e6f5d230ddc, ce83ea8f34ab416caab176440a6464f1
I20260806 04:49:42.253786 24954 raft_consensus.cc:2726] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 04:49:42.280229 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:42.279457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:55821)
0806 04:49:42.279935 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:42.280041 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":240,"threads_started":1}
I20260806 04:49:42.749550 24956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:42.748874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:40991)
0806 04:49:42.749302 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:42.749386 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":214,"threads_started":1}
I20260806 04:49:43.223691 24957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:43.222987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:33133)
0806 04:49:43.223406 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:43.223489 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":204,"threads_started":1}
I20260806 04:49:43.282135 24958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:43.281428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:54167)
0806 04:49:43.281829 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:43.281907 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":209,"threads_started":1}
I20260806 04:49:43.751191 24959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:43.750484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:56467)
0806 04:49:43.750943 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:43.751027 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":250,"threads_started":1}
I20260806 04:49:44.225639 24960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:44.224609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:34069)
0806 04:49:44.225205 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:44.225345 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":304,"threads_started":1}
I20260806 04:49:44.283751 24961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:44.282949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:37453)
0806 04:49:44.283498 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:44.283577 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":272,"threads_started":1}
I20260806 04:49:44.752873 24962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:44.752046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:50829)
0806 04:49:44.752579 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:44.752655 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":333,"threads_started":1}
I20260806 04:49:44.980791 24963 raft_consensus.cc:482] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:49:44.980966 24963 raft_consensus.cc:504] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:44.981601 24963 leader_election.cc:288] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645), ce83ea8f34ab416caab176440a6464f1 (127.7.113.194:33255)
W20260806 04:49:44.982540 24558 leader_election.cc:341] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645): Not found: Tablet not found: c82fc68605054891b23eccbbfa48d124
W20260806 04:49:44.982785 24556 leader_election.cc:341] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce83ea8f34ab416caab176440a6464f1 (127.7.113.194:33255): Not found: Tablet not found: c82fc68605054891b23eccbbfa48d124
I20260806 04:49:44.982921 24556 leader_election.cc:302] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaccf143f12c48b9aceced4a4d4e9696; no voters: 147dce0a455c4161bd7b6e6f5d230ddc, ce83ea8f34ab416caab176440a6464f1
I20260806 04:49:44.983176 24963 raft_consensus.cc:2726] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 04:49:45.227382 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:45.226669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:46589)
0806 04:49:45.227117 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:45.227194 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":250,"threads_started":1}
I20260806 04:49:45.285451 24965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:45.284642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:49899)
0806 04:49:45.285123 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:45.285219 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":225,"threads_started":1}
I20260806 04:49:45.754487 24966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:45.753678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:56229)
0806 04:49:45.754196 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:45.754300 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":243,"threads_started":1}
I20260806 04:49:46.229502 24967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:46.228398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:49531)
0806 04:49:46.229074 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:46.229204 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":276,"threads_started":1}
I20260806 04:49:46.287078 24968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:46.286305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:39865)
0806 04:49:46.286766 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:46.286902 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":249,"threads_started":1}
I20260806 04:49:46.756395 24969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:46.755597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:47933)
0806 04:49:46.756081 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:46.756180 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":264,"threads_started":1}
I20260806 04:49:47.231163 24970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:47.230391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:43063)
0806 04:49:47.230898 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:47.230982 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":290,"threads_started":1}
I20260806 04:49:47.288710 24971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:47.287957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:50317)
0806 04:49:47.288431 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:47.288514 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":233,"threads_started":1}
I20260806 04:49:47.758091 24972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:47.757290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:46937)
0806 04:49:47.757827 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:47.757937 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":306,"threads_started":1}
I20260806 04:49:48.232908 24973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:48.231992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:44487)
0806 04:49:48.232573 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:48.232679 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":293,"threads_started":1}
I20260806 04:49:48.290315 24974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:48.289656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:48823)
0806 04:49:48.290049 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:48.290126 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":202,"threads_started":1}
I20260806 04:49:48.759660 24975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:48.758949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:38819)
0806 04:49:48.759390 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:48.759471 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":238,"threads_started":1}
I20260806 04:49:49.234584 24976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:49.233899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:38707)
0806 04:49:49.234325 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:49.234405 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":222,"threads_started":1}
I20260806 04:49:49.291939 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:49.291173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:34853)
0806 04:49:49.291690 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:49.291773 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":315,"threads_started":1}
I20260806 04:49:49.624114 24978 raft_consensus.cc:482] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:49:49.624454 24978 raft_consensus.cc:504] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:49.625279 24978 leader_election.cc:288] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645), ce83ea8f34ab416caab176440a6464f1 (127.7.113.194:33255)
W20260806 04:49:49.626119 24558 leader_election.cc:341] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645): Not found: Tablet not found: c82fc68605054891b23eccbbfa48d124
W20260806 04:49:49.626363 24556 leader_election.cc:341] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce83ea8f34ab416caab176440a6464f1 (127.7.113.194:33255): Not found: Tablet not found: c82fc68605054891b23eccbbfa48d124
I20260806 04:49:49.626490 24556 leader_election.cc:302] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaccf143f12c48b9aceced4a4d4e9696; no voters: 147dce0a455c4161bd7b6e6f5d230ddc, ce83ea8f34ab416caab176440a6464f1
I20260806 04:49:49.626780 24978 raft_consensus.cc:2726] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 04:49:49.761503 24979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:49.760774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:35583)
0806 04:49:49.761249 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:49.761330 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":249,"threads_started":1}
I20260806 04:49:50.236413 24980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:50.235448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:43357)
0806 04:49:50.236057 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:50.236171 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":313,"threads_started":1}
I20260806 04:49:50.293455 24981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:50.292751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:57265)
0806 04:49:50.293202 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:50.293290 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":235,"threads_started":1}
I20260806 04:49:50.763000 24982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:50.762334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:60671)
0806 04:49:50.762769 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:50.762843 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":231,"threads_started":1}
I20260806 04:49:51.226054 24983 raft_consensus.cc:482] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:49:51.226253 24983 raft_consensus.cc:504] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147dce0a455c4161bd7b6e6f5d230ddc" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36645 } } peers { permanent_uuid: "aaccf143f12c48b9aceced4a4d4e9696" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 39317 } } peers { permanent_uuid: "ce83ea8f34ab416caab176440a6464f1" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 33255 } }
I20260806 04:49:51.226801 24983 leader_election.cc:288] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645), ce83ea8f34ab416caab176440a6464f1 (127.7.113.194:33255)
W20260806 04:49:51.227809 24558 leader_election.cc:341] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 147dce0a455c4161bd7b6e6f5d230ddc (127.7.113.195:36645): Not found: Tablet not found: c82fc68605054891b23eccbbfa48d124
W20260806 04:49:51.228106 24556 leader_election.cc:341] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce83ea8f34ab416caab176440a6464f1 (127.7.113.194:33255): Not found: Tablet not found: c82fc68605054891b23eccbbfa48d124
I20260806 04:49:51.228200 24556 leader_election.cc:302] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaccf143f12c48b9aceced4a4d4e9696; no voters: 147dce0a455c4161bd7b6e6f5d230ddc, ce83ea8f34ab416caab176440a6464f1
I20260806 04:49:51.228500 24983 raft_consensus.cc:2726] T c82fc68605054891b23eccbbfa48d124 P aaccf143f12c48b9aceced4a4d4e9696 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 04:49:51.237921 24984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:51.237285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:35225)
0806 04:49:51.237674 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:51.237750 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":203,"threads_started":1}
I20260806 04:49:51.295004 24985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:51.294269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:33769)
0806 04:49:51.294747 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:51.294835 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":252,"threads_started":1}
I20260806 04:49:51.764767 24986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:51.763979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:52647)
0806 04:49:51.764485 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:51.764590 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":315,"threads_started":1}
I20260806 04:49:52.239821 24987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:52.238928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:52927)
0806 04:49:52.239486 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:52.239587 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":307,"threads_started":1}
I20260806 04:49:52.296821 24988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:52.295987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:51511)
0806 04:49:52.296514 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:52.296605 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":309,"threads_started":1}
I20260806 04:49:52.766621 24989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:52.765705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:54071)
0806 04:49:52.766232 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:52.766340 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":309,"threads_started":1}
I20260806 04:49:53.241536 24990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:53.240761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:35759)
0806 04:49:53.241235 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:53.241337 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":280,"threads_started":1}
I20260806 04:49:53.298621 24991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:53.297910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.193:60833)
0806 04:49:53.298372 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:53.298462 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":225,"threads_started":1}
I20260806 04:49:53.768551 24993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:53.767723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.194:47341)
0806 04:49:53.768217 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:53.768390 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":264,"threads_started":1}
I20260806 04:49:54.215876 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 24498
I20260806 04:49:54.243577 24995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:54.242700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:42335 (local address 127.7.113.195:42291)
0806 04:49:54.243218 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:54.243367 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.254:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":264,"threads_started":1}
I20260806 04:49:54.243791 24994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:54.216997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37552 (local address 127.7.113.193:39317)
0806 04:49:54.217768 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:54.217783 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:54.217820 (+ 37us) server_negotiation.cc:407] Connection header received
0806 04:49:54.217903 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:54.217912 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:54.218224 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:54.218436 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:54.219923 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:54.220989 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:54.222371 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:54.223408 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:54.223576 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:54.237742 (+ 14166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:54.237758 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:54.237773 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:54.237830 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:54.240819 (+ 2989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:54.241479 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:54.241486 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:54.241489 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:54.241642 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:54.241983 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:54.241987 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:54.241990 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:54.242467 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:54.242795 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:54.243125 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 04:49:54.243423 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":448,"threads_started":1}
I20260806 04:49:54.245232 24667 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:49:54.334131 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 24498
I20260806 04:49:54.355414 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 24676
I20260806 04:49:54.369035 24998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:54.356562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53306 (local address 127.7.113.194:33255)
0806 04:49:54.357573 (+ 1011us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:54.357581 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:54.357603 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:49:54.357670 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:54.357682 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:54.357748 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:54.357839 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:54.359117 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:54.359866 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:54.361159 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:54.361584 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:54.361674 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:54.364202 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:54.364207 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:54.364210 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:54.364246 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:54.366758 (+ 2512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:54.367338 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:54.367342 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:54.367344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:54.367478 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:54.367812 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:54.367815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:54.367817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:54.368071 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:54.368363 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:54.368566 (+ 203us) server_negotiation.cc:299] Negotiation successful
0806 04:49:54.368744 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":873,"thread_start_us":760,"threads_started":1}
I20260806 04:49:54.369792 24801 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:49:54.454245 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 24676
I20260806 04:49:54.473132 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 24809
I20260806 04:49:54.485785 25000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:54.473848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60430 (local address 127.7.113.195:36645)
0806 04:49:54.474435 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:54.474439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:54.474457 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:49:54.474513 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:54.474516 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:54.474582 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:54.474672 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:54.476024 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:54.476880 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:54.478105 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:54.478535 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:54.478619 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:54.481079 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:54.481083 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:54.481086 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:54.481114 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:54.483534 (+ 2420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:54.484144 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:54.484148 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:54.484150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:54.484336 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:54.484684 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:54.484687 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:54.484689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:54.484931 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:54.485128 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:54.485331 (+ 203us) server_negotiation.cc:299] Negotiation successful
0806 04:49:54.485489 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":311,"threads_started":1}
I20260806 04:49:54.486434 24932 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:49:54.567899 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 24809
2026-08-06T04:49:54Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64698 ms)
[----------] 30 tests from SecurityITest (295805 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:49:54 dist-test-slave-0b58 krb5kdc[25004](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:49:54 dist-test-slave-0b58 krb5kdc[25004](info): set up 2 sockets
Aug 06 04:49:54 dist-test-slave-0b58 krb5kdc[25004](info): commencing operation
krb5kdc: starting...
W20260806 04:49:55.698737 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.001s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:49:55 dist-test-slave-0b58 krb5kdc[25004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:49:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:49:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:49:55.975893 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:33315
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:32947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:33315
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:49:56.312958 25017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:49:56.313223 25017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:49:56.313313 25017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:49:56.320174 25017 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:49:56.320283 25017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:49:56.320333 25017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:49:56.320381 25017 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:49:56.320426 25017 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:49:56.329813 25017 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:32947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:33315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:33315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:49:56.330914 25017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:49:56.332135 25017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:49:56.343750 25022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:56.343822 25023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:56.343801 25025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:49:56.344599 25017 server_base.cc:1034] running on GCE node
I20260806 04:49:56.345360 25017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:49:56.346623 25017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:49:56.347862 25017 hybrid_clock.cc:648] HybridClock initialized: now 1785991796347822 us; error 48 us; skew 500 ppm
I20260806 04:49:56.348201 25017 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:49:56 dist-test-slave-0b58 krb5kdc[25004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991796, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:49:56.351138 25017 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:49:56.352511 25017 webserver.cc:460] Webserver started at http://127.7.113.254:39615/ using document root <none> and password file <none>
I20260806 04:49:56.353114 25017 fs_manager.cc:359] Metadata directory not provided
I20260806 04:49:56.353211 25017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:49:56.353530 25017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:49:56.356330 25017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "c459a190aa604d75859be12706efdd7f"
format_stamp: "Formatted at 2026-08-06 04:49:56 on dist-test-slave-0b58"
server_key: "25eabbfe4f4ded37cef658b69894cead"
server_key_iv: "ca60b46e7924cc1f0ae92ed5ef3a4e7f"
server_key_version: "encryptionkey@0"
I20260806 04:49:56.357048 25017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "c459a190aa604d75859be12706efdd7f"
format_stamp: "Formatted at 2026-08-06 04:49:56 on dist-test-slave-0b58"
server_key: "25eabbfe4f4ded37cef658b69894cead"
server_key_iv: "ca60b46e7924cc1f0ae92ed5ef3a4e7f"
server_key_version: "encryptionkey@0"
I20260806 04:49:56.361794 25017 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 04:49:56.365224 25033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:56.366417 25017 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:49:56.366593 25017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "c459a190aa604d75859be12706efdd7f"
format_stamp: "Formatted at 2026-08-06 04:49:56 on dist-test-slave-0b58"
server_key: "25eabbfe4f4ded37cef658b69894cead"
server_key_iv: "ca60b46e7924cc1f0ae92ed5ef3a4e7f"
server_key_version: "encryptionkey@0"
I20260806 04:49:56.366786 25017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:49:56.392608 25017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:49:56.396389 25017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:49:56.396672 25017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:49:56.415026 25017 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:33315
I20260806 04:49:56.415064 25084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:33315 every 8 connection(s)
I20260806 04:49:56.416375 25017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:49:56.419872 25085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:49:56.424710 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 25017
I20260806 04:49:56.424926 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:49:56.425565 7623 external_mini_cluster.cc:1428] Setting key 0fc091d46567c71de4dc729cb2bee487
I20260806 04:49:56.432614 25085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f: Bootstrap starting.
I20260806 04:49:56.436311 25085 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f: Neither blocks nor log segments found. Creating new log.
I20260806 04:49:56.437608 25085 log.cc:824] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f: Log is configured to *not* fsync() on all Append() calls
I20260806 04:49:56.440558 25085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f: No bootstrap required, opened a new log
Aug 06 04:49:56 dist-test-slave-0b58 krb5kdc[25004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:49:56.449632 25085 raft_consensus.cc:348] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c459a190aa604d75859be12706efdd7f" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 33315 } }
I20260806 04:49:56.450094 25085 raft_consensus.cc:374] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:49:56.450212 25085 raft_consensus.cc:729] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c459a190aa604d75859be12706efdd7f, State: Initialized, Role: FOLLOWER
I20260806 04:49:56.450897 25085 consensus_queue.cc:260] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c459a190aa604d75859be12706efdd7f" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 33315 } }
I20260806 04:49:56.451185 25085 raft_consensus.cc:388] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:49:56.451347 25085 raft_consensus.cc:482] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:49:56.451529 25085 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:49:56.453440 25088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:56.427549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40846 (local address 127.7.113.254:33315)
0806 04:49:56.431326 (+ 3777us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:56.431341 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:56.431399 (+ 58us) server_negotiation.cc:407] Connection header received
0806 04:49:56.433790 (+ 2391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:56.433816 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:56.434306 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:56.434767 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:56.436244 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:56.438309 (+ 2065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:56.439890 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:56.440920 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:56.441126 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:56.445084 (+ 3958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:56.445099 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:56.445120 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:56.445179 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:56.449153 (+ 3974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:56.449827 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:56.449835 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:56.449841 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:56.450056 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:56.450511 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:56.450518 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:56.450523 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:56.451165 (+ 642us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:56.451470 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:56.451980 (+ 510us) server_negotiation.cc:299] Negotiation successful
0806 04:49:56.452450 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3545,"thread_start_us":3326,"threads_started":1}
I20260806 04:49:56.454169 25085 raft_consensus.cc:504] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c459a190aa604d75859be12706efdd7f" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 33315 } }
I20260806 04:49:56.454660 25085 leader_election.cc:302] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c459a190aa604d75859be12706efdd7f; no voters:
I20260806 04:49:56.455366 25085 leader_election.cc:288] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:49:56.455497 25090 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:49:56.456141 25090 raft_consensus.cc:686] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [term 1 LEADER]: Becoming Leader. State: Replica: c459a190aa604d75859be12706efdd7f, State: Running, Role: LEADER
I20260806 04:49:56.456796 25090 consensus_queue.cc:237] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c459a190aa604d75859be12706efdd7f" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 33315 } }
I20260806 04:49:56.459002 25085 sys_catalog.cc:564] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:49:56.459797 25091 sys_catalog.cc:455] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c459a190aa604d75859be12706efdd7f. Latest consensus state: current_term: 1 leader_uuid: "c459a190aa604d75859be12706efdd7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c459a190aa604d75859be12706efdd7f" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 33315 } } }
I20260806 04:49:56.459710 25092 sys_catalog.cc:455] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c459a190aa604d75859be12706efdd7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c459a190aa604d75859be12706efdd7f" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 33315 } } }
I20260806 04:49:56.460139 25091 sys_catalog.cc:458] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [sys.catalog]: This master's current role is: LEADER
I20260806 04:49:56.460139 25092 sys_catalog.cc:458] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f [sys.catalog]: This master's current role is: LEADER
I20260806 04:49:56.461082 25095 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:49:56.466128 25095 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:49:56.476609 25095 catalog_manager.cc:1347] Generated new cluster ID: 88dc48e5a865478ba160bfcadab974e6
I20260806 04:49:56.476795 25095 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:49:56.522532 25095 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:49:56.523792 25095 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:49:56.529863 25095 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f: Generated new TSK 0
I20260806 04:49:56.530599 25095 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:49:56.612685 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:33315
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:32947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:49:56.944185 25111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:49:56.944504 25111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:49:56.944664 25111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:49:56.951700 25111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:49:56.951843 25111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:49:56.952024 25111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:49:56.961427 25111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:32947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:33315
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:49:56.962654 25111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:49:56.963902 25111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:49:56.977458 25116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:56.977407 25117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:56.977494 25119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:49:56.978502 25111 server_base.cc:1034] running on GCE node
I20260806 04:49:56.979192 25111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:49:56.980108 25111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:49:56.981319 25111 hybrid_clock.cc:648] HybridClock initialized: now 1785991796981257 us; error 61 us; skew 500 ppm
I20260806 04:49:56.981640 25111 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:49:56 dist-test-slave-0b58 krb5kdc[25004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991796, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:49:56.984809 25111 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:49:56.986130 25111 webserver.cc:460] Webserver started at http://127.7.113.193:36827/ using document root <none> and password file <none>
I20260806 04:49:56.986804 25111 fs_manager.cc:359] Metadata directory not provided
I20260806 04:49:56.986903 25111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:49:56.987152 25111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:49:56.990041 25111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "100e0c42828f4921af22068ab349f3f8"
format_stamp: "Formatted at 2026-08-06 04:49:56 on dist-test-slave-0b58"
server_key: "815db893978269a95f6f654b823c87d2"
server_key_iv: "5b821ac31e403b1a39547cd45a2abd71"
server_key_version: "encryptionkey@0"
I20260806 04:49:56.990888 25111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "100e0c42828f4921af22068ab349f3f8"
format_stamp: "Formatted at 2026-08-06 04:49:56 on dist-test-slave-0b58"
server_key: "815db893978269a95f6f654b823c87d2"
server_key_iv: "5b821ac31e403b1a39547cd45a2abd71"
server_key_version: "encryptionkey@0"
I20260806 04:49:56.995930 25111 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 04:49:56.999219 25127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:57.000525 25111 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 04:49:57.000696 25111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "100e0c42828f4921af22068ab349f3f8"
format_stamp: "Formatted at 2026-08-06 04:49:56 on dist-test-slave-0b58"
server_key: "815db893978269a95f6f654b823c87d2"
server_key_iv: "5b821ac31e403b1a39547cd45a2abd71"
server_key_version: "encryptionkey@0"
I20260806 04:49:57.000877 25111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:49:57.025980 25111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:49:57.030297 25111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:49:57.030537 25111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:49:57.031477 25111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:49:57.032742 25111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:49:57.032812 25111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:57.032891 25111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:49:57.032932 25111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:57.065944 25111 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:41601
I20260806 04:49:57.066026 25239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:41601 every 8 connection(s)
I20260806 04:49:57.067226 25111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:49:57.072003 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 25111
I20260806 04:49:57.072206 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:49:57.072912 7623 external_mini_cluster.cc:1428] Setting key ab7792b9bda8438375454f61a816adf8
Aug 06 04:49:57 dist-test-slave-0b58 krb5kdc[25004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991796, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:49:57.087205 25242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:57.069910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:48191 (local address 127.7.113.254:33315)
0806 04:49:57.070410 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:57.070415 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:57.071321 (+ 906us) server_negotiation.cc:407] Connection header received
0806 04:49:57.073404 (+ 2083us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:57.073410 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:57.073505 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:57.073629 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:57.075326 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:57.076036 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:57.077583 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:57.077992 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:57.078134 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:57.081520 (+ 3386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:57.081525 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:57.081528 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:57.081559 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:57.084233 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:57.085000 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:57.085006 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:57.085011 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:57.085141 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:57.085566 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:57.085572 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:57.085579 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:57.085812 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:57.085964 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:57.086617 (+ 653us) server_negotiation.cc:299] Negotiation successful
0806 04:49:57.086837 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":284,"threads_started":1}
I20260806 04:49:57.088061 25243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:57.070463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:33315 (local address 127.7.113.193:48191)
0806 04:49:57.071122 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:57.071195 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:57.073150 (+ 1955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:57.073859 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:57.073887 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:57.074628 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:49:57.075161 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:57.075179 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:57.076202 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:57.076206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:57.077417 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:57.077429 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:57.078231 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:57.078241 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:57.078466 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:57.079167 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:49:57.079190 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:49:57.081314 (+ 2124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:49:57.084447 (+ 3133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:57.084454 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:57.084473 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:57.084879 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:57.085251 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:57.085255 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:57.085258 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:57.085437 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:57.085936 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:49:57.085943 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:49:57.086262 (+ 319us) client_negotiation.cc:769] Sending connection context
0806 04:49:57.086512 (+ 250us) client_negotiation.cc:240] Negotiation successful
0806 04:49:57.086985 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":261,"threads_started":1}
I20260806 04:49:57.089609 25240 heartbeater.cc:347] Connected to a master server at 127.7.113.254:33315
I20260806 04:49:57.089956 25240 heartbeater.cc:464] Registering TS with master...
I20260806 04:49:57.090758 25240 heartbeater.cc:511] Master 127.7.113.254:33315 requested a full tablet report, sending...
I20260806 04:49:57.093143 25050 ts_manager.cc:194] Registered new tserver with Master: 100e0c42828f4921af22068ab349f3f8 (127.7.113.193:41601)
I20260806 04:49:57.095212 25050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:48191
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:49:57.141598 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:33315
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:32947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:49:57.465600 25246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:49:57.465835 25246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:49:57.466012 25246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:49:57.473268 25246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:49:57.473392 25246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:49:57.473579 25246 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:49:57.482908 25246 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:32947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:33315
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:49:57.484076 25246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:49:57.485371 25246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:49:57.497654 25251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:57.497696 25252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:57.497994 25255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:49:57.498921 25246 server_base.cc:1034] running on GCE node
I20260806 04:49:57.499490 25246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:49:57.500479 25246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:49:57.501694 25246 hybrid_clock.cc:648] HybridClock initialized: now 1785991797501659 us; error 49 us; skew 500 ppm
I20260806 04:49:57.501984 25246 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:49:57 dist-test-slave-0b58 krb5kdc[25004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991797, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:49:57.504961 25246 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:49:57.506419 25246 webserver.cc:460] Webserver started at http://127.7.113.194:45331/ using document root <none> and password file <none>
I20260806 04:49:57.507038 25246 fs_manager.cc:359] Metadata directory not provided
I20260806 04:49:57.507133 25246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:49:57.507386 25246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:49:57.510064 25246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "660806c6736e459b8d067854eb4e75be"
format_stamp: "Formatted at 2026-08-06 04:49:57 on dist-test-slave-0b58"
server_key: "f14116d6a2d7fd8516a65a48af31b11b"
server_key_iv: "07e57674d2b635a6306c44c2a5b6cf3a"
server_key_version: "encryptionkey@0"
I20260806 04:49:57.510763 25246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "660806c6736e459b8d067854eb4e75be"
format_stamp: "Formatted at 2026-08-06 04:49:57 on dist-test-slave-0b58"
server_key: "f14116d6a2d7fd8516a65a48af31b11b"
server_key_iv: "07e57674d2b635a6306c44c2a5b6cf3a"
server_key_version: "encryptionkey@0"
I20260806 04:49:57.515472 25246 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260806 04:49:57.518642 25262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:57.519829 25246 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 04:49:57.519946 25246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "660806c6736e459b8d067854eb4e75be"
format_stamp: "Formatted at 2026-08-06 04:49:57 on dist-test-slave-0b58"
server_key: "f14116d6a2d7fd8516a65a48af31b11b"
server_key_iv: "07e57674d2b635a6306c44c2a5b6cf3a"
server_key_version: "encryptionkey@0"
I20260806 04:49:57.520093 25246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:49:57.538558 25246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:49:57.542268 25246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:49:57.542519 25246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:49:57.543390 25246 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:49:57.544637 25246 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:49:57.544723 25246 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:57.544803 25246 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:49:57.544847 25246 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:57.577804 25246 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:32901
I20260806 04:49:57.577840 25374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:32901 every 8 connection(s)
I20260806 04:49:57.579054 25246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:49:57.588472 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 25246
I20260806 04:49:57.588680 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:49:57.589301 7623 external_mini_cluster.cc:1428] Setting key db6b3cfc88fdd7af3c8c7062851b9b31
Aug 06 04:49:57 dist-test-slave-0b58 krb5kdc[25004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991797, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:49:57.599200 25242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:57.581467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:32927 (local address 127.7.113.254:33315)
0806 04:49:57.581654 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:57.581659 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:57.582785 (+ 1126us) server_negotiation.cc:407] Connection header received
0806 04:49:57.584688 (+ 1903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:57.584694 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:57.584797 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:57.584908 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:57.586320 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:57.587063 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:57.589260 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:57.589739 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:57.589914 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:57.593730 (+ 3816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:57.593734 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:57.593746 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:57.593775 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:57.596314 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:57.597001 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:57.597006 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:57.597010 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:57.597148 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:57.597585 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:57.597588 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:57.597591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:57.597851 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:57.598004 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:57.598644 (+ 640us) server_negotiation.cc:299] Negotiation successful
0806 04:49:57.598887 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 04:49:57.600044 25377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:57.581940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:33315 (local address 127.7.113.194:32927)
0806 04:49:57.582620 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:57.582666 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:57.584435 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:57.585127 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:57.585134 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:57.585622 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:49:57.586136 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:57.586168 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:57.587223 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:57.587227 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:57.588774 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:57.588789 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:57.589985 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:57.589990 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:57.590300 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:57.591010 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:49:57.591049 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:49:57.593510 (+ 2461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:49:57.596454 (+ 2944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:57.596462 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:57.596476 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:57.596874 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:57.597266 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:57.597273 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:57.597276 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:57.597456 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:57.597977 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:49:57.597984 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:49:57.598290 (+ 306us) client_negotiation.cc:769] Sending connection context
0806 04:49:57.598535 (+ 245us) client_negotiation.cc:240] Negotiation successful
0806 04:49:57.599010 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":281,"threads_started":1}
I20260806 04:49:57.601480 25375 heartbeater.cc:347] Connected to a master server at 127.7.113.254:33315
I20260806 04:49:57.601753 25375 heartbeater.cc:464] Registering TS with master...
I20260806 04:49:57.602418 25375 heartbeater.cc:511] Master 127.7.113.254:33315 requested a full tablet report, sending...
I20260806 04:49:57.603811 25050 ts_manager.cc:194] Registered new tserver with Master: 660806c6736e459b8d067854eb4e75be (127.7.113.194:32901)
I20260806 04:49:57.604758 25050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:32927
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:49:57.655174 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:33315
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:32947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:49:57.981835 25380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:49:57.982178 25380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:49:57.982368 25380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:49:57.989375 25380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:49:57.989516 25380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:49:57.989696 25380 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:49:57.998998 25380 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:32947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:33315
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:49:58.000291 25380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:49:58.001575 25380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:49:58.015038 25389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:58.015164 25387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:58.015178 25385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:49:58.015954 25380 server_base.cc:1034] running on GCE node
I20260806 04:49:58.016630 25380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:49:58.017531 25380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:49:58.018728 25380 hybrid_clock.cc:648] HybridClock initialized: now 1785991798018676 us; error 48 us; skew 500 ppm
I20260806 04:49:58.019025 25380 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:49:58 dist-test-slave-0b58 krb5kdc[25004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991798, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:49:58.022007 25380 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:49:58.023376 25380 webserver.cc:460] Webserver started at http://127.7.113.195:41257/ using document root <none> and password file <none>
I20260806 04:49:58.024094 25380 fs_manager.cc:359] Metadata directory not provided
I20260806 04:49:58.024242 25380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:49:58.024644 25380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:49:58.027490 25380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "d95f25f372fb43b595003472bc58eb1c"
format_stamp: "Formatted at 2026-08-06 04:49:58 on dist-test-slave-0b58"
server_key: "cbe530b5cd85e58dd606fa0f86119bc6"
server_key_iv: "7f84af20942e4adbfa94e1931a9a7e5e"
server_key_version: "encryptionkey@0"
I20260806 04:49:58.028357 25380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "d95f25f372fb43b595003472bc58eb1c"
format_stamp: "Formatted at 2026-08-06 04:49:58 on dist-test-slave-0b58"
server_key: "cbe530b5cd85e58dd606fa0f86119bc6"
server_key_iv: "7f84af20942e4adbfa94e1931a9a7e5e"
server_key_version: "encryptionkey@0"
I20260806 04:49:58.033327 25380 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 04:49:58.036567 25396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:58.037820 25380 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:49:58.038002 25380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "d95f25f372fb43b595003472bc58eb1c"
format_stamp: "Formatted at 2026-08-06 04:49:58 on dist-test-slave-0b58"
server_key: "cbe530b5cd85e58dd606fa0f86119bc6"
server_key_iv: "7f84af20942e4adbfa94e1931a9a7e5e"
server_key_version: "encryptionkey@0"
I20260806 04:49:58.038205 25380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:49:58.062928 25380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:49:58.067313 25380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:49:58.067607 25380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:49:58.068686 25380 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:49:58.070171 25380 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:49:58.070267 25380 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:58.070442 25380 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:49:58.070518 25380 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:58.098968 25240 heartbeater.cc:503] Master 127.7.113.254:33315 was elected leader, sending a full tablet report...
I20260806 04:49:58.105137 25380 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:45339
I20260806 04:49:58.105186 25508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:45339 every 8 connection(s)
I20260806 04:49:58.106451 25380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:49:58.112008 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 25380
I20260806 04:49:58.112213 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:49:58.112797 7623 external_mini_cluster.cc:1428] Setting key e1cf1a9fe7afcfa7fc2cd025ac3bb1ec
Aug 06 04:49:58 dist-test-slave-0b58 krb5kdc[25004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991798, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:49:58.126075 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.108869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:32985 (local address 127.7.113.254:33315)
0806 04:49:58.109361 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:58.109365 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:58.110158 (+ 793us) server_negotiation.cc:407] Connection header received
0806 04:49:58.111954 (+ 1796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:58.111959 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:58.112048 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:58.112194 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:58.114205 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.115139 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.116830 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.117217 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.117350 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.120594 (+ 3244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:58.120599 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:58.120602 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:58.120632 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:58.123031 (+ 2399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:58.123723 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:58.123728 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:58.123733 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:58.123862 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:58.124368 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:58.124378 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:58.124380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:58.124624 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:58.124783 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:58.125444 (+ 661us) server_negotiation.cc:299] Negotiation successful
0806 04:49:58.125654 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":280,"threads_started":1}
I20260806 04:49:58.127147 25512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.109359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:33315 (local address 127.7.113.195:32985)
0806 04:49:58.110015 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:58.110049 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:58.111686 (+ 1637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:58.112537 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:58.112549 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:58.113276 (+ 727us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:49:58.114013 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:58.114041 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.115301 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.115306 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:58.116688 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:58.116704 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.117433 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.117440 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:58.117679 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.118296 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:49:58.118317 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:49:58.120398 (+ 2081us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:49:58.123177 (+ 2779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:58.123185 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:58.123199 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:58.123597 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:58.123971 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:49:58.123976 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:49:58.123979 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:49:58.124223 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:49:58.124759 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:49:58.124766 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:49:58.125083 (+ 317us) client_negotiation.cc:769] Sending connection context
0806 04:49:58.125338 (+ 255us) client_negotiation.cc:240] Negotiation successful
0806 04:49:58.125840 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":254,"threads_started":1}
I20260806 04:49:58.128551 25509 heartbeater.cc:347] Connected to a master server at 127.7.113.254:33315
I20260806 04:49:58.128851 25509 heartbeater.cc:464] Registering TS with master...
I20260806 04:49:58.129529 25509 heartbeater.cc:511] Master 127.7.113.254:33315 requested a full tablet report, sending...
I20260806 04:49:58.130913 25049 ts_manager.cc:194] Registered new tserver with Master: d95f25f372fb43b595003472bc58eb1c (127.7.113.195:45339)
I20260806 04:49:58.131799 25049 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:32985
I20260806 04:49:58.140355 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:49:58.157801 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.145039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40848 (local address 127.7.113.254:33315)
0806 04:49:58.145225 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:58.145233 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:58.145639 (+ 406us) server_negotiation.cc:407] Connection header received
0806 04:49:58.145839 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:58.145845 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:58.145922 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:58.146024 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:58.147568 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.148369 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.149678 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.150104 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.150242 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.152655 (+ 2413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:58.152661 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:58.152672 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:58.152703 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:58.155146 (+ 2443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:58.155780 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:58.155787 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:58.155791 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:58.155918 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:58.156305 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:58.156312 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:58.156315 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:58.156630 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:58.156898 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:58.157256 (+ 358us) server_negotiation.cc:299] Negotiation successful
0806 04:49:58.157493 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 04:49:58.161762 25049 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40848:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:49:58.168679 25049 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:49:58.206908 25524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.180966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56322 (local address 127.7.113.195:45339)
0806 04:49:58.198909 (+ 17943us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:58.198919 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:58.198954 (+ 35us) server_negotiation.cc:407] Connection header received
0806 04:49:58.199051 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:58.199060 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:58.199311 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:58.199824 (+ 513us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:49:58.200206 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.201812 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.204110 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.205692 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.205842 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.206090 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:58.206365 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 04:49:58.206526 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17738,"thread_start_us":17565,"threads_started":1}
I20260806 04:49:58.207003 25523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.180862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:45339 (local address 127.0.0.1:56322)
0806 04:49:58.193133 (+ 12271us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:58.193151 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:58.193256 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:58.199530 (+ 6274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:58.199536 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:58.199567 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:49:58.200033 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:58.200047 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.201974 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.201980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:58.203885 (+ 1905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:58.203897 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.205880 (+ 1983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.205886 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:58.206083 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.206135 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 04:49:58.206312 (+ 177us) client_negotiation.cc:240] Negotiation successful
0806 04:49:58.206494 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12156,"mutex_wait_us":22,"thread_start_us":12398,"threads_started":1}
I20260806 04:49:58.207600 25526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.182620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:32901 (local address 127.0.0.1:55344)
0806 04:49:58.198476 (+ 15856us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:58.198498 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:58.198646 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:58.199423 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:58.199431 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:58.199459 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:49:58.200433 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:58.200445 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.202192 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.202199 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:58.204539 (+ 2340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:58.204559 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.206719 (+ 2160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.206726 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:58.206951 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.206992 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 04:49:58.207069 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 04:49:58.207197 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15682,"mutex_wait_us":4,"thread_start_us":15507,"threads_started":1}
I20260806 04:49:58.207947 25525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.181300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58464 (local address 127.7.113.193:41601)
0806 04:49:58.199236 (+ 17936us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:58.199243 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:58.199268 (+ 25us) server_negotiation.cc:407] Connection header received
0806 04:49:58.199365 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:58.199373 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:58.199590 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:58.199779 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:49:58.201159 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.202398 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.204920 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.206405 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.206526 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.206731 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:58.207413 (+ 682us) server_negotiation.cc:299] Negotiation successful
0806 04:49:58.207589 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17752,"thread_start_us":17585,"threads_started":1}
I20260806 04:49:58.208184 25527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.183236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55344 (local address 127.7.113.194:32901)
0806 04:49:58.197936 (+ 14700us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:58.197949 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:58.198822 (+ 873us) server_negotiation.cc:407] Connection header received
0806 04:49:58.198943 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:58.198951 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:58.199220 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:58.199414 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:49:58.200623 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.202068 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.204731 (+ 2663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.206238 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.206372 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.206560 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:58.207748 (+ 1188us) server_negotiation.cc:299] Negotiation successful
0806 04:49:58.207914 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14481,"thread_start_us":14345,"threads_started":1}
I20260806 04:49:58.211474 25444 tablet_service.cc:1467] Processing CreateTablet for tablet 1daa0013c32841fdb1d535d3ce09b4a2 (DEFAULT_TABLE table=test-table [id=76d1b3f9b31b41739c03a29374f7dfd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:49:58.211474 25310 tablet_service.cc:1467] Processing CreateTablet for tablet 1daa0013c32841fdb1d535d3ce09b4a2 (DEFAULT_TABLE table=test-table [id=76d1b3f9b31b41739c03a29374f7dfd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:49:58.212446 25522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.180817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:41601 (local address 127.0.0.1:58464)
0806 04:49:58.192828 (+ 12011us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:58.192906 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:58.193104 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:58.200105 (+ 7001us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:58.200115 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:58.200144 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:49:58.201013 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:58.201022 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.202536 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.202545 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:58.204759 (+ 2214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:58.204772 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.206875 (+ 2103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.206881 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:58.207052 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.207084 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 04:49:58.207141 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 04:49:58.207238 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11673,"thread_start_us":11505,"threads_started":1}
I20260806 04:49:58.212965 25310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1daa0013c32841fdb1d535d3ce09b4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:49:58.212961 25444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1daa0013c32841fdb1d535d3ce09b4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:49:58.215440 25175 tablet_service.cc:1467] Processing CreateTablet for tablet 1daa0013c32841fdb1d535d3ce09b4a2 (DEFAULT_TABLE table=test-table [id=76d1b3f9b31b41739c03a29374f7dfd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:49:58.216689 25175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1daa0013c32841fdb1d535d3ce09b4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:49:58.231117 25528 tablet_bootstrap.cc:492] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c: Bootstrap starting.
I20260806 04:49:58.231920 25529 tablet_bootstrap.cc:492] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8: Bootstrap starting.
I20260806 04:49:58.234903 25529 tablet_bootstrap.cc:654] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8: Neither blocks nor log segments found. Creating new log.
I20260806 04:49:58.235793 25530 tablet_bootstrap.cc:492] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be: Bootstrap starting.
I20260806 04:49:58.236224 25529 log.cc:824] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8: Log is configured to *not* fsync() on all Append() calls
I20260806 04:49:58.238266 25528 tablet_bootstrap.cc:654] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c: Neither blocks nor log segments found. Creating new log.
I20260806 04:49:58.239214 25528 log.cc:824] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c: Log is configured to *not* fsync() on all Append() calls
I20260806 04:49:58.239241 25530 tablet_bootstrap.cc:654] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be: Neither blocks nor log segments found. Creating new log.
I20260806 04:49:58.239537 25529 tablet_bootstrap.cc:492] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8: No bootstrap required, opened a new log
I20260806 04:49:58.239820 25529 ts_tablet_manager.cc:1397] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.004s
I20260806 04:49:58.240461 25530 log.cc:824] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be: Log is configured to *not* fsync() on all Append() calls
I20260806 04:49:58.242466 25528 tablet_bootstrap.cc:492] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c: No bootstrap required, opened a new log
I20260806 04:49:58.242718 25528 ts_tablet_manager.cc:1397] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.006s
I20260806 04:49:58.244035 25530 tablet_bootstrap.cc:492] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be: No bootstrap required, opened a new log
I20260806 04:49:58.244309 25530 ts_tablet_manager.cc:1397] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 04:49:58.248109 25529 raft_consensus.cc:348] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95f25f372fb43b595003472bc58eb1c" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45339 } } peers { permanent_uuid: "100e0c42828f4921af22068ab349f3f8" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41601 } } peers { permanent_uuid: "660806c6736e459b8d067854eb4e75be" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 32901 } }
I20260806 04:49:58.248550 25529 raft_consensus.cc:374] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:49:58.248652 25529 raft_consensus.cc:729] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 100e0c42828f4921af22068ab349f3f8, State: Initialized, Role: FOLLOWER
I20260806 04:49:58.249226 25529 consensus_queue.cc:260] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95f25f372fb43b595003472bc58eb1c" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45339 } } peers { permanent_uuid: "100e0c42828f4921af22068ab349f3f8" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41601 } } peers { permanent_uuid: "660806c6736e459b8d067854eb4e75be" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 32901 } }
I20260806 04:49:58.251085 25529 ts_tablet_manager.cc:1428] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260806 04:49:58.253396 25528 raft_consensus.cc:348] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95f25f372fb43b595003472bc58eb1c" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45339 } } peers { permanent_uuid: "100e0c42828f4921af22068ab349f3f8" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41601 } } peers { permanent_uuid: "660806c6736e459b8d067854eb4e75be" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 32901 } }
I20260806 04:49:58.253826 25528 raft_consensus.cc:374] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:49:58.253923 25528 raft_consensus.cc:729] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d95f25f372fb43b595003472bc58eb1c, State: Initialized, Role: FOLLOWER
I20260806 04:49:58.254577 25528 consensus_queue.cc:260] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95f25f372fb43b595003472bc58eb1c" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45339 } } peers { permanent_uuid: "100e0c42828f4921af22068ab349f3f8" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41601 } } peers { permanent_uuid: "660806c6736e459b8d067854eb4e75be" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 32901 } }
I20260806 04:49:58.254657 25530 raft_consensus.cc:348] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95f25f372fb43b595003472bc58eb1c" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45339 } } peers { permanent_uuid: "100e0c42828f4921af22068ab349f3f8" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41601 } } peers { permanent_uuid: "660806c6736e459b8d067854eb4e75be" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 32901 } }
I20260806 04:49:58.255100 25530 raft_consensus.cc:374] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:49:58.255249 25530 raft_consensus.cc:729] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 660806c6736e459b8d067854eb4e75be, State: Initialized, Role: FOLLOWER
I20260806 04:49:58.255964 25509 heartbeater.cc:503] Master 127.7.113.254:33315 was elected leader, sending a full tablet report...
I20260806 04:49:58.255949 25530 consensus_queue.cc:260] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95f25f372fb43b595003472bc58eb1c" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45339 } } peers { permanent_uuid: "100e0c42828f4921af22068ab349f3f8" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41601 } } peers { permanent_uuid: "660806c6736e459b8d067854eb4e75be" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 32901 } }
I20260806 04:49:58.256654 25528 ts_tablet_manager.cc:1428] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260806 04:49:58.257009 25375 heartbeater.cc:503] Master 127.7.113.254:33315 was elected leader, sending a full tablet report...
I20260806 04:49:58.257560 25530 ts_tablet_manager.cc:1428] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
W20260806 04:49:58.319725 25241 tablet.cc:2369] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:49:58.331115 25376 tablet.cc:2369] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:49:58.358083 25510 tablet.cc:2369] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:49:58.460987 25535 raft_consensus.cc:482] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:49:58.461316 25535 raft_consensus.cc:504] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95f25f372fb43b595003472bc58eb1c" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45339 } } peers { permanent_uuid: "100e0c42828f4921af22068ab349f3f8" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41601 } } peers { permanent_uuid: "660806c6736e459b8d067854eb4e75be" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 32901 } }
I20260806 04:49:58.463048 25535 leader_election.cc:288] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 100e0c42828f4921af22068ab349f3f8 (127.7.113.193:41601), 660806c6736e459b8d067854eb4e75be (127.7.113.194:32901)
I20260806 04:49:58.469619 25527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.463713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:44851 (local address 127.7.113.194:32901)
0806 04:49:58.463890 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:58.463894 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:58.463908 (+ 14us) server_negotiation.cc:407] Connection header received
0806 04:49:58.463965 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:58.463969 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:58.464021 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:58.464116 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:49:58.464584 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.465597 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.467585 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.468814 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.468936 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.469000 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:58.469346 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 04:49:58.469445 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 04:49:58.469681 25512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.463324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:32901 (local address 127.7.113.195:44851)
0806 04:49:58.463537 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:58.463557 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:58.463688 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:58.464145 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:58.464149 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:58.464181 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:49:58.464416 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:58.464425 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.465714 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.465719 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:58.467443 (+ 1724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:58.467457 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.468980 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.468986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:58.469158 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.469190 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 04:49:58.469275 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 04:49:58.469389 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":48}
I20260806 04:49:58.470746 25525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.463578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:40553 (local address 127.7.113.193:41601)
0806 04:49:58.463811 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:58.463820 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:58.464513 (+ 693us) server_negotiation.cc:407] Connection header received
0806 04:49:58.464669 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:58.464673 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:58.464730 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:58.464796 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:49:58.465410 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.466418 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.468611 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.469720 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.469882 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.469965 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:58.470402 (+ 437us) server_negotiation.cc:299] Negotiation successful
0806 04:49:58.470569 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 04:49:58.470886 25537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.463531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:41601 (local address 127.7.113.195:40553)
0806 04:49:58.464407 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0806 04:49:58.464421 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 04:49:58.464544 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:49:58.464841 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:49:58.464846 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:49:58.464871 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:49:58.465261 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:58.465272 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.466564 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.466568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:58.468454 (+ 1886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:49:58.468470 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.470044 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.470049 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:49:58.470186 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.470207 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 04:49:58.470331 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 04:49:58.470494 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":767,"mutex_wait_us":24,"thread_start_us":470,"threads_started":1}
I20260806 04:49:58.470846 25330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1daa0013c32841fdb1d535d3ce09b4a2" candidate_uuid: "d95f25f372fb43b595003472bc58eb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "660806c6736e459b8d067854eb4e75be" is_pre_election: true
I20260806 04:49:58.471495 25330 raft_consensus.cc:2454] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d95f25f372fb43b595003472bc58eb1c in term 0.
I20260806 04:49:58.471930 25195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1daa0013c32841fdb1d535d3ce09b4a2" candidate_uuid: "d95f25f372fb43b595003472bc58eb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "100e0c42828f4921af22068ab349f3f8" is_pre_election: true
I20260806 04:49:58.472095 25400 leader_election.cc:302] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 660806c6736e459b8d067854eb4e75be, d95f25f372fb43b595003472bc58eb1c; no voters:
I20260806 04:49:58.472453 25535 raft_consensus.cc:2781] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:49:58.472436 25195 raft_consensus.cc:2454] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d95f25f372fb43b595003472bc58eb1c in term 0.
I20260806 04:49:58.472599 25535 raft_consensus.cc:482] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:49:58.472689 25535 raft_consensus.cc:3037] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:49:58.474821 25535 raft_consensus.cc:504] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95f25f372fb43b595003472bc58eb1c" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45339 } } peers { permanent_uuid: "100e0c42828f4921af22068ab349f3f8" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41601 } } peers { permanent_uuid: "660806c6736e459b8d067854eb4e75be" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 32901 } }
I20260806 04:49:58.475410 25535 leader_election.cc:288] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [CANDIDATE]: Term 1 election: Requested vote from peers 100e0c42828f4921af22068ab349f3f8 (127.7.113.193:41601), 660806c6736e459b8d067854eb4e75be (127.7.113.194:32901)
I20260806 04:49:58.475831 25195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1daa0013c32841fdb1d535d3ce09b4a2" candidate_uuid: "d95f25f372fb43b595003472bc58eb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "100e0c42828f4921af22068ab349f3f8"
I20260806 04:49:58.475909 25330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1daa0013c32841fdb1d535d3ce09b4a2" candidate_uuid: "d95f25f372fb43b595003472bc58eb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "660806c6736e459b8d067854eb4e75be"
I20260806 04:49:58.476063 25195 raft_consensus.cc:3037] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:49:58.476083 25330 raft_consensus.cc:3037] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:49:58.479280 25195 raft_consensus.cc:2454] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d95f25f372fb43b595003472bc58eb1c in term 1.
I20260806 04:49:58.479280 25330 raft_consensus.cc:2454] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d95f25f372fb43b595003472bc58eb1c in term 1.
I20260806 04:49:58.479686 25397 leader_election.cc:302] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 100e0c42828f4921af22068ab349f3f8, d95f25f372fb43b595003472bc58eb1c; no voters:
I20260806 04:49:58.479995 25535 raft_consensus.cc:2781] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:49:58.480515 25535 raft_consensus.cc:686] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [term 1 LEADER]: Becoming Leader. State: Replica: d95f25f372fb43b595003472bc58eb1c, State: Running, Role: LEADER
I20260806 04:49:58.480988 25535 consensus_queue.cc:237] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95f25f372fb43b595003472bc58eb1c" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45339 } } peers { permanent_uuid: "100e0c42828f4921af22068ab349f3f8" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41601 } } peers { permanent_uuid: "660806c6736e459b8d067854eb4e75be" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 32901 } }
I20260806 04:49:58.485332 25050 catalog_manager.cc:5495] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c reported cstate change: term changed from 0 to 1, leader changed from <none> to d95f25f372fb43b595003472bc58eb1c (127.7.113.195). New cstate: current_term: 1 leader_uuid: "d95f25f372fb43b595003472bc58eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95f25f372fb43b595003472bc58eb1c" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 45339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "100e0c42828f4921af22068ab349f3f8" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "660806c6736e459b8d067854eb4e75be" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20260806 04:49:58.567173 25524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.561722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56330 (local address 127.7.113.195:45339)
0806 04:49:58.561918 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:58.561925 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:58.562031 (+ 106us) server_negotiation.cc:407] Connection header received
0806 04:49:58.562298 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:58.562302 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:58.562377 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:58.562531 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:49:58.562948 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.563641 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.565071 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.565470 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.565597 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.566088 (+ 491us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:49:58.566599 (+ 511us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:49:58.566765 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:58.566821 (+ 56us) server_negotiation.cc:299] Negotiation successful
0806 04:49:58.566909 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 04:49:58.575054 25330 raft_consensus.cc:1261] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be [term 1 FOLLOWER]: Refusing update from remote peer d95f25f372fb43b595003472bc58eb1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:49:58.575054 25195 raft_consensus.cc:1261] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8 [term 1 FOLLOWER]: Refusing update from remote peer d95f25f372fb43b595003472bc58eb1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:49:58.575994 25535 consensus_queue.cc:1035] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "660806c6736e459b8d067854eb4e75be" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:49:58.576300 25538 consensus_queue.cc:1035] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "100e0c42828f4921af22068ab349f3f8" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:49:58.590163 25541 mvcc.cc:205] Tried to move back new op lower bound from 7315422406953463808 to 7315422406581407744. Current Snapshot: MvccSnapshot[applied={T|T < 7315422406953463808}]
I20260806 04:49:58.605158 25050 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:49:58.605453 25050 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:49:58.609004 25050 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c459a190aa604d75859be12706efdd7f: Sending DeleteTablet for 3 replicas of tablet 1daa0013c32841fdb1d535d3ce09b4a2
I20260806 04:49:58.610090 25444 tablet_service.cc:1514] Processing DeleteTablet for tablet 1daa0013c32841fdb1d535d3ce09b4a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:49:58 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:56322
I20260806 04:49:58.610184 25310 tablet_service.cc:1514] Processing DeleteTablet for tablet 1daa0013c32841fdb1d535d3ce09b4a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:49:58 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:55344
I20260806 04:49:58.610507 25175 tablet_service.cc:1514] Processing DeleteTablet for tablet 1daa0013c32841fdb1d535d3ce09b4a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:49:58 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:58464
I20260806 04:49:58.613760 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 25111
I20260806 04:49:58.622884 25550 tablet_replica.cc:330] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c: stopping tablet replica
I20260806 04:49:58.624140 25550 raft_consensus.cc:2229] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:49:58.624876 25550 raft_consensus.cc:2258] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:49:58.628382 25550 ts_tablet_manager.cc:1905] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:49:58.629336 25551 tablet_replica.cc:330] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be: stopping tablet replica
I20260806 04:49:58.629758 25551 raft_consensus.cc:2229] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:49:58.630235 25551 raft_consensus.cc:2258] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:49:58.630965 25552 tablet_replica.cc:330] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8: stopping tablet replica
I20260806 04:49:58.631340 25552 raft_consensus.cc:2229] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:49:58.631832 25552 raft_consensus.cc:2258] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:49:58.633775 25551 ts_tablet_manager.cc:1905] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:49:58.639519 25550 ts_tablet_manager.cc:1918] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:49:58.639834 25550 log.cc:1196] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/1daa0013c32841fdb1d535d3ce09b4a2
Aug 06 04:49:58 dist-test-slave-0b58 krb5kdc[25004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:49:58.640630 25551 ts_tablet_manager.cc:1918] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:49:58.640877 25551 log.cc:1196] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/1daa0013c32841fdb1d535d3ce09b4a2
I20260806 04:49:58.641531 25551 ts_tablet_manager.cc:1939] T 1daa0013c32841fdb1d535d3ce09b4a2 P 660806c6736e459b8d067854eb4e75be: Deleting consensus metadata
I20260806 04:49:58.641554 25552 ts_tablet_manager.cc:1905] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:49:58.643481 25037 catalog_manager.cc:4841] TS 660806c6736e459b8d067854eb4e75be (127.7.113.194:32901): tablet 1daa0013c32841fdb1d535d3ce09b4a2 (table test-table [id=76d1b3f9b31b41739c03a29374f7dfd6]) successfully deleted
I20260806 04:49:58.647274 25550 ts_tablet_manager.cc:1939] T 1daa0013c32841fdb1d535d3ce09b4a2 P d95f25f372fb43b595003472bc58eb1c: Deleting consensus metadata
I20260806 04:49:58.648631 25552 ts_tablet_manager.cc:1918] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:49:58.648912 25552 log.cc:1196] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/1daa0013c32841fdb1d535d3ce09b4a2
I20260806 04:49:58.649134 25035 catalog_manager.cc:4841] TS d95f25f372fb43b595003472bc58eb1c (127.7.113.195:45339): tablet 1daa0013c32841fdb1d535d3ce09b4a2 (table test-table [id=76d1b3f9b31b41739c03a29374f7dfd6]) successfully deleted
I20260806 04:49:58.649573 25552 ts_tablet_manager.cc:1939] T 1daa0013c32841fdb1d535d3ce09b4a2 P 100e0c42828f4921af22068ab349f3f8: Deleting consensus metadata
I20260806 04:49:58.649812 25525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.616067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58466 (local address 127.7.113.193:41601)
0806 04:49:58.616236 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:58.616243 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:58.628768 (+ 12525us) server_negotiation.cc:407] Connection header received
0806 04:49:58.628946 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:58.628955 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:58.629064 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:58.629194 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:58.631615 (+ 2421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.632873 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.634823 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.635416 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.635558 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.641942 (+ 6384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:58.641956 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:58.641971 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:58.642018 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:58.646116 (+ 4098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:58.646964 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:58.646978 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:58.646982 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:58.647154 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:58.647642 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:58.647647 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:58.647651 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:58.648076 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:58.648386 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:58.649058 (+ 672us) server_negotiation.cc:299] Negotiation successful
0806 04:49:58.649330 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 04:49:58.650920 25235 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:49:58.651275 25034 catalog_manager.cc:4841] TS 100e0c42828f4921af22068ab349f3f8 (127.7.113.193:41601): tablet 1daa0013c32841fdb1d535d3ce09b4a2 (table test-table [id=76d1b3f9b31b41739c03a29374f7dfd6]) successfully deleted
I20260806 04:49:58.761052 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 25111
I20260806 04:49:58.780620 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 25246
Aug 06 04:49:58 dist-test-slave-0b58 krb5kdc[25004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:49:58.797514 25527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.781519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55352 (local address 127.7.113.194:32901)
0806 04:49:58.781727 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:58.781733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:58.781755 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:49:58.781923 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:58.781929 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:58.782011 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:58.782121 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:58.783291 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.784445 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.785751 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.786407 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.786527 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.790701 (+ 4174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:58.790719 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:58.790739 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:58.790787 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:58.794447 (+ 3660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:58.795076 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:58.795086 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:58.795090 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:58.795248 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:58.795621 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:58.795626 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:58.795630 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:58.796077 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:58.796395 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:58.796913 (+ 518us) server_negotiation.cc:299] Negotiation successful
0806 04:49:58.797129 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 04:49:58.798236 25370 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:49:58.888356 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 25246
I20260806 04:49:58.914053 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 25380
Aug 06 04:49:58 dist-test-slave-0b58 krb5kdc[25004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:49:58.938787 25524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:58.915277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56336 (local address 127.7.113.195:45339)
0806 04:49:58.915499 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:58.915503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:58.915745 (+ 242us) server_negotiation.cc:407] Connection header received
0806 04:49:58.915968 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:58.915976 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:58.916104 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:58.916228 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:58.918300 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.919685 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.921618 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:58.922477 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:58.922634 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:58.929819 (+ 7185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:58.929838 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:58.929862 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:49:58.929922 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:58.934660 (+ 4738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:58.935656 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:58.935668 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:58.935673 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:58.935875 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:49:58.936404 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:49:58.936412 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:49:58.936417 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:49:58.936918 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:58.937265 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:58.937978 (+ 713us) server_negotiation.cc:299] Negotiation successful
0806 04:49:58.938243 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 04:49:58.940447 25504 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:49:59.061796 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 25380
I20260806 04:49:59.083212 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 25017
I20260806 04:49:59.084408 25080 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:49:59.194324 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 25017
2026-08-06T04:49:59Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4630 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-06T04:49:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:49:59Z Disabled control of system clock
I20260806 04:49:59.280664 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:35881
--webserver_interface=127.7.113.254
--webserver_port=0
--builtin_ntp_servers=127.7.113.212:36903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:35881
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 04:49:59.603060 25561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:49:59.603307 25561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:49:59.603469 25561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:49:59.610430 25561 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:49:59.610551 25561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:49:59.610626 25561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:49:59.610745 25561 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:49:59.610823 25561 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:49:59.619552 25561 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:35881
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:35881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:49:59.620754 25561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:49:59.622478 25561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:49:59.633912 25567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:59.633937 25570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:49:59.633862 25568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:49:59.634994 25561 server_base.cc:1034] running on GCE node
I20260806 04:49:59.635773 25561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:49:59.637176 25561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:49:59.638415 25561 hybrid_clock.cc:648] HybridClock initialized: now 1785991799638378 us; error 48 us; skew 500 ppm
I20260806 04:49:59.638767 25561 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:49:59.645411 25561 webserver.cc:460] Webserver started at http://127.7.113.254:43183/ using document root <none> and password file <none>
I20260806 04:49:59.646049 25561 fs_manager.cc:359] Metadata directory not provided
I20260806 04:49:59.646133 25561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:49:59.646422 25561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:49:59.649291 25561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "ed4c6639008945908d10ad030b4c23f5"
format_stamp: "Formatted at 2026-08-06 04:49:59 on dist-test-slave-0b58"
server_key: "dcd638efe755379fc7792cb1a0034ae6"
server_key_iv: "51246c81b13adf546fb6d2ecd3b34d10"
server_key_version: "encryptionkey@0"
I20260806 04:49:59.650040 25561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "ed4c6639008945908d10ad030b4c23f5"
format_stamp: "Formatted at 2026-08-06 04:49:59 on dist-test-slave-0b58"
server_key: "dcd638efe755379fc7792cb1a0034ae6"
server_key_iv: "51246c81b13adf546fb6d2ecd3b34d10"
server_key_version: "encryptionkey@0"
I20260806 04:49:59.655046 25561 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 04:49:59.658224 25576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:49:59.659505 25561 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:49:59.659669 25561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "ed4c6639008945908d10ad030b4c23f5"
format_stamp: "Formatted at 2026-08-06 04:49:59 on dist-test-slave-0b58"
server_key: "dcd638efe755379fc7792cb1a0034ae6"
server_key_iv: "51246c81b13adf546fb6d2ecd3b34d10"
server_key_version: "encryptionkey@0"
I20260806 04:49:59.659883 25561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:49:59.675910 25561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:49:59.676728 25561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:49:59.677021 25561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:49:59.695089 25561 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:35881
I20260806 04:49:59.695108 25627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:35881 every 8 connection(s)
I20260806 04:49:59.696425 25561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:49:59.699959 25628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:49:59.703619 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 25561
I20260806 04:49:59.703835 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:49:59.704346 7623 external_mini_cluster.cc:1428] Setting key f6fc12c5cd7f1db5ed53069b8a2960cc
I20260806 04:49:59.710774 25628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5: Bootstrap starting.
I20260806 04:49:59.714316 25628 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5: Neither blocks nor log segments found. Creating new log.
I20260806 04:49:59.715538 25628 log.cc:824] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5: Log is configured to *not* fsync() on all Append() calls
I20260806 04:49:59.718672 25628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5: No bootstrap required, opened a new log
I20260806 04:49:59.718748 25632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:49:59.706152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36176 (local address 127.7.113.254:35881)
0806 04:49:59.707100 (+ 948us) server_negotiation.cc:206] Beginning negotiation
0806 04:49:59.707109 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:49:59.707147 (+ 38us) server_negotiation.cc:407] Connection header received
0806 04:49:59.709369 (+ 2222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:49:59.709390 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:49:59.709787 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:49:59.710075 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:49:59.710704 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:59.712048 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:59.714075 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:49:59.714800 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:49:59.714925 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:49:59.716318 (+ 1393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:49:59.716333 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:49:59.716357 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:49:59.717107 (+ 750us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:49:59.717183 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:49:59.717208 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:49:59.717306 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 04:49:59.717538 (+ 232us) server_negotiation.cc:299] Negotiation successful
0806 04:49:59.717853 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":348,"threads_started":1}
I20260806 04:49:59.726657 25628 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4c6639008945908d10ad030b4c23f5" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35881 } }
I20260806 04:49:59.727016 25628 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:49:59.727126 25628 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4c6639008945908d10ad030b4c23f5, State: Initialized, Role: FOLLOWER
I20260806 04:49:59.727628 25628 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4c6639008945908d10ad030b4c23f5" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35881 } }
I20260806 04:49:59.727873 25628 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:49:59.728018 25628 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:49:59.728195 25628 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:49:59.730538 25628 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4c6639008945908d10ad030b4c23f5" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35881 } }
I20260806 04:49:59.730998 25628 leader_election.cc:302] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed4c6639008945908d10ad030b4c23f5; no voters:
I20260806 04:49:59.731519 25628 leader_election.cc:288] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:49:59.731658 25634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:49:59.733016 25634 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [term 1 LEADER]: Becoming Leader. State: Replica: ed4c6639008945908d10ad030b4c23f5, State: Running, Role: LEADER
I20260806 04:49:59.733523 25634 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4c6639008945908d10ad030b4c23f5" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35881 } }
I20260806 04:49:59.733732 25628 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:49:59.736469 25636 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed4c6639008945908d10ad030b4c23f5. Latest consensus state: current_term: 1 leader_uuid: "ed4c6639008945908d10ad030b4c23f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4c6639008945908d10ad030b4c23f5" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35881 } } }
I20260806 04:49:59.736542 25635 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed4c6639008945908d10ad030b4c23f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4c6639008945908d10ad030b4c23f5" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35881 } } }
I20260806 04:49:59.737025 25635 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [sys.catalog]: This master's current role is: LEADER
I20260806 04:49:59.737022 25636 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5 [sys.catalog]: This master's current role is: LEADER
I20260806 04:49:59.738209 25643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:49:59.742564 25643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:49:59.751721 25643 catalog_manager.cc:1347] Generated new cluster ID: fb10da34f9774ceda0e821988137ca1a
I20260806 04:49:59.751855 25643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:49:59.758380 25643 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:49:59.759969 25643 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:49:59.769439 25643 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5: Generated new TSK 0
I20260806 04:49:59.770185 25643 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:49:59.785569 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:35881
--builtin_ntp_servers=127.7.113.212:36903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 04:50:00.140152 25653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:00.140960 25653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:00.141129 25653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:00.148222 25653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:00.148397 25653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:00.148590 25653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:50:00.157773 25653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:35881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:00.159049 25653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:00.160792 25653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:00.174095 25659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:00.174141 25658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:00.174031 25661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:00.175034 25653 server_base.cc:1034] running on GCE node
I20260806 04:50:00.175657 25653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:00.176626 25653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:00.177886 25653 hybrid_clock.cc:648] HybridClock initialized: now 1785991800177840 us; error 38 us; skew 500 ppm
I20260806 04:50:00.178222 25653 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:50:00.180603 25653 webserver.cc:460] Webserver started at http://127.7.113.193:37185/ using document root <none> and password file <none>
I20260806 04:50:00.181332 25653 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:00.181475 25653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:00.181797 25653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:00.184844 25653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "faaa172d0ea84ce98887e8239c1ce551"
format_stamp: "Formatted at 2026-08-06 04:50:00 on dist-test-slave-0b58"
server_key: "c13552b1623ca97594f2bd5021038218"
server_key_iv: "c6ea3e5caf14829cdd48b42dcfdac7c9"
server_key_version: "encryptionkey@0"
I20260806 04:50:00.185720 25653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "faaa172d0ea84ce98887e8239c1ce551"
format_stamp: "Formatted at 2026-08-06 04:50:00 on dist-test-slave-0b58"
server_key: "c13552b1623ca97594f2bd5021038218"
server_key_iv: "c6ea3e5caf14829cdd48b42dcfdac7c9"
server_key_version: "encryptionkey@0"
I20260806 04:50:00.190888 25653 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 04:50:00.194211 25667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:00.195431 25653 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 04:50:00.195600 25653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "faaa172d0ea84ce98887e8239c1ce551"
format_stamp: "Formatted at 2026-08-06 04:50:00 on dist-test-slave-0b58"
server_key: "c13552b1623ca97594f2bd5021038218"
server_key_iv: "c6ea3e5caf14829cdd48b42dcfdac7c9"
server_key_version: "encryptionkey@0"
I20260806 04:50:00.195814 25653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:00.208021 25653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:00.208819 25653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:00.209175 25653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:00.210075 25653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:00.211463 25653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:00.211588 25653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:00.211721 25653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:00.211817 25653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:00.249235 25653 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:46713
I20260806 04:50:00.249286 25780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:46713 every 8 connection(s)
I20260806 04:50:00.250524 25653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:50:00.260007 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 25653
I20260806 04:50:00.260205 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:50:00.260656 7623 external_mini_cluster.cc:1428] Setting key eb1f789b4816835fbed8977a0b29a832
I20260806 04:50:00.262235 25783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:00.252896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:37197 (local address 127.7.113.254:35881)
0806 04:50:00.253345 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:00.253352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:00.254419 (+ 1067us) server_negotiation.cc:407] Connection header received
0806 04:50:00.256237 (+ 1818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:00.256241 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:00.256355 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:00.256449 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:00.257393 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:00.258101 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:00.259498 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:00.259883 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:00.260013 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:00.261350 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:00.261356 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:00.261361 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:00.261385 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:00.261426 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:00.261438 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:00.261532 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:00.261743 (+ 211us) server_negotiation.cc:299] Negotiation successful
0806 04:50:00.261836 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":210,"threads_started":1}
I20260806 04:50:00.263155 25784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:00.253433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:35881 (local address 127.7.113.193:37197)
0806 04:50:00.254272 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:00.254310 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:00.256009 (+ 1699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:00.256634 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:00.256642 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:00.256726 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:00.257257 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:00.257272 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:00.258215 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:00.258218 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:00.259383 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:00.259395 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:00.260114 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:00.260124 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:00.260398 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:00.261067 (+ 669us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:50:00.261069 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:00.261107 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:50:00.261173 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:00.261542 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:00.261555 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:00.261563 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 04:50:00.261734 (+ 171us) client_negotiation.cc:240] Negotiation successful
0806 04:50:00.262085 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":261,"threads_started":1}
I20260806 04:50:00.263465 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:35881
--builtin_ntp_servers=127.7.113.212:36903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 04:50:00.264753 25781 heartbeater.cc:347] Connected to a master server at 127.7.113.254:35881
I20260806 04:50:00.265054 25781 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:00.265713 25781 heartbeater.cc:511] Master 127.7.113.254:35881 requested a full tablet report, sending...
I20260806 04:50:00.267760 25593 ts_manager.cc:194] Registered new tserver with Master: faaa172d0ea84ce98887e8239c1ce551 (127.7.113.193:46713)
I20260806 04:50:00.269960 25593 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.113.193:37197
W20260806 04:50:00.590189 25785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:00.590454 25785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:00.590538 25785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:00.597506 25785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:00.597626 25785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:00.597735 25785 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:50:00.606595 25785 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:35881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:00.607808 25785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:00.609579 25785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:00.622133 25791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:00.622277 25790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:00.622153 25793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:00.623391 25785 server_base.cc:1034] running on GCE node
I20260806 04:50:00.623961 25785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:00.624941 25785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:00.626176 25785 hybrid_clock.cc:648] HybridClock initialized: now 1785991800626126 us; error 29 us; skew 500 ppm
I20260806 04:50:00.626515 25785 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:50:00.628790 25785 webserver.cc:460] Webserver started at http://127.7.113.194:45885/ using document root <none> and password file <none>
I20260806 04:50:00.629454 25785 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:00.629578 25785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:00.629910 25785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:00.632682 25785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "40c0117d0b9b434c98f490e7afafd55b"
format_stamp: "Formatted at 2026-08-06 04:50:00 on dist-test-slave-0b58"
server_key: "8e434d099b7457c608d4d3754d2358e9"
server_key_iv: "eb611da6242cc5cfaf8745b6840f9ff8"
server_key_version: "encryptionkey@0"
I20260806 04:50:00.633436 25785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "40c0117d0b9b434c98f490e7afafd55b"
format_stamp: "Formatted at 2026-08-06 04:50:00 on dist-test-slave-0b58"
server_key: "8e434d099b7457c608d4d3754d2358e9"
server_key_iv: "eb611da6242cc5cfaf8745b6840f9ff8"
server_key_version: "encryptionkey@0"
I20260806 04:50:00.638072 25785 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 04:50:00.641309 25799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:00.642554 25785 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:50:00.642726 25785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "40c0117d0b9b434c98f490e7afafd55b"
format_stamp: "Formatted at 2026-08-06 04:50:00 on dist-test-slave-0b58"
server_key: "8e434d099b7457c608d4d3754d2358e9"
server_key_iv: "eb611da6242cc5cfaf8745b6840f9ff8"
server_key_version: "encryptionkey@0"
I20260806 04:50:00.642956 25785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:00.661366 25785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:00.662168 25785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:00.662462 25785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:00.663452 25785 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:00.664943 25785 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:00.665071 25785 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:00.665196 25785 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:00.665287 25785 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:00.698110 25785 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:42313
I20260806 04:50:00.698158 25912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:42313 every 8 connection(s)
I20260806 04:50:00.699561 25785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:50:00.704041 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 25785
I20260806 04:50:00.704248 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:50:00.704716 7623 external_mini_cluster.cc:1428] Setting key a4696723b15e7dec22fef95f670972c3
I20260806 04:50:00.707758 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:35881
--builtin_ntp_servers=127.7.113.212:36903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 04:50:00.714318 25783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:00.702176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:38787 (local address 127.7.113.254:35881)
0806 04:50:00.702403 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:00.702409 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:00.703831 (+ 1422us) server_negotiation.cc:407] Connection header received
0806 04:50:00.706259 (+ 2428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:00.706264 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:00.706334 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:00.706418 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:00.707730 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:00.708917 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:00.711170 (+ 2253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:00.711882 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:00.712019 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:00.713466 (+ 1447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:00.713474 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:00.713481 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:00.713504 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:00.713544 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:00.713562 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:00.713654 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:00.713845 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 04:50:00.713954 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 04:50:00.715166 25915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:00.702744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:35881 (local address 127.7.113.194:38787)
0806 04:50:00.703674 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:00.703712 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:00.705957 (+ 2245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:00.706654 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:00.706667 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:00.706778 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:00.707529 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:00.707549 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:00.709096 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:00.709101 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:00.710993 (+ 1892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:00.711008 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:00.712109 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:00.712120 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:00.712434 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:00.713171 (+ 737us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:50:00.713174 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:00.713209 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:50:00.713285 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:00.713657 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:00.713665 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:00.713670 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 04:50:00.713801 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 04:50:00.714072 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":266,"threads_started":1}
I20260806 04:50:00.716617 25913 heartbeater.cc:347] Connected to a master server at 127.7.113.254:35881
I20260806 04:50:00.716909 25913 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:00.717574 25913 heartbeater.cc:511] Master 127.7.113.254:35881 requested a full tablet report, sending...
I20260806 04:50:00.718966 25593 ts_manager.cc:194] Registered new tserver with Master: 40c0117d0b9b434c98f490e7afafd55b (127.7.113.194:42313)
I20260806 04:50:00.720124 25593 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.113.194:38787
W20260806 04:50:01.034183 25916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:01.034525 25916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:01.034673 25916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:01.045547 25916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:01.045730 25916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:01.045923 25916 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:50:01.055446 25916 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:35881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:01.056782 25916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:01.058662 25916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:01.071856 25922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:01.071918 25924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:01.071887 25921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:01.072597 25916 server_base.cc:1034] running on GCE node
I20260806 04:50:01.073189 25916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:01.074151 25916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:01.075383 25916 hybrid_clock.cc:648] HybridClock initialized: now 1785991801075345 us; error 49 us; skew 500 ppm
I20260806 04:50:01.075703 25916 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:50:01.077980 25916 webserver.cc:460] Webserver started at http://127.7.113.195:44005/ using document root <none> and password file <none>
I20260806 04:50:01.078661 25916 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:01.078748 25916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:01.079022 25916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:01.081811 25916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96"
format_stamp: "Formatted at 2026-08-06 04:50:01 on dist-test-slave-0b58"
server_key: "9ec2216d48415140cfca0bb438efdafd"
server_key_iv: "f4e7e5a10b5538cd9dd065402f2afc16"
server_key_version: "encryptionkey@0"
I20260806 04:50:01.082572 25916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96"
format_stamp: "Formatted at 2026-08-06 04:50:01 on dist-test-slave-0b58"
server_key: "9ec2216d48415140cfca0bb438efdafd"
server_key_iv: "f4e7e5a10b5538cd9dd065402f2afc16"
server_key_version: "encryptionkey@0"
I20260806 04:50:01.087558 25916 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 04:50:01.090951 25930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:01.092235 25916 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:50:01.092468 25916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96"
format_stamp: "Formatted at 2026-08-06 04:50:01 on dist-test-slave-0b58"
server_key: "9ec2216d48415140cfca0bb438efdafd"
server_key_iv: "f4e7e5a10b5538cd9dd065402f2afc16"
server_key_version: "encryptionkey@0"
I20260806 04:50:01.092693 25916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:01.112962 25916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:01.113868 25916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:01.114195 25916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:01.115175 25916 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:01.116673 25916 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:01.116797 25916 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:01.116942 25916 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:01.117033 25916 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:01.151140 25916 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:36103
I20260806 04:50:01.151232 26043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:36103 every 8 connection(s)
I20260806 04:50:01.152433 25916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:50:01.159119 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 25916
I20260806 04:50:01.159309 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:50:01.159762 7623 external_mini_cluster.cc:1428] Setting key b4e80b47626b7b6ae5e0219e12c5f0d7
I20260806 04:50:01.165622 25783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.154917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:33419 (local address 127.7.113.254:35881)
0806 04:50:01.155104 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:01.155108 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:01.156407 (+ 1299us) server_negotiation.cc:407] Connection header received
0806 04:50:01.158388 (+ 1981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:01.158394 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:01.158497 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:01.158615 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:01.159756 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.160760 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.162809 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.163266 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.163359 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.164993 (+ 1634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:01.164998 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:01.165001 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:01.165018 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:01.165049 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:01.165060 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:01.165130 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:01.165319 (+ 189us) server_negotiation.cc:299] Negotiation successful
0806 04:50:01.165394 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 04:50:01.166594 26046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.155300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:35881 (local address 127.7.113.195:33419)
0806 04:50:01.156194 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:01.156234 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:01.158103 (+ 1869us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:01.158844 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:01.158852 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:01.158933 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:01.159580 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:01.159597 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.160962 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.160968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:01.162651 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:01.162665 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.163469 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.163474 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:01.163721 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.164671 (+ 950us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:50:01.164673 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:01.164726 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:50:01.164805 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:01.165144 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:01.165151 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:01.165156 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 04:50:01.165289 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 04:50:01.165554 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":256,"threads_started":1}
I20260806 04:50:01.167840 26044 heartbeater.cc:347] Connected to a master server at 127.7.113.254:35881
I20260806 04:50:01.168131 26044 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:01.168879 26044 heartbeater.cc:511] Master 127.7.113.254:35881 requested a full tablet report, sending...
I20260806 04:50:01.170199 25593 ts_manager.cc:194] Registered new tserver with Master: 6af51bfde15b4a9e9c226a2cdb0dbc96 (127.7.113.195:36103)
I20260806 04:50:01.170936 25593 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.113.195:33419
I20260806 04:50:01.174580 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:50:01.185665 25783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.178591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58958 (local address 127.7.113.254:35881)
0806 04:50:01.178832 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:01.178841 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:01.179179 (+ 338us) server_negotiation.cc:407] Connection header received
0806 04:50:01.179292 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:01.179296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:01.179360 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:01.179435 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:01.179933 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.180967 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.182878 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.183483 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.183566 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.184954 (+ 1388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:01.184960 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:01.184965 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:01.184984 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:01.185019 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:01.185033 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:01.185085 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:01.185299 (+ 214us) server_negotiation.cc:299] Negotiation successful
0806 04:50:01.185384 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 04:50:01.190658 25593 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58958:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:50:01.197847 25593 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:50:01.220804 26057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.209384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41930 (local address 127.7.113.193:46713)
0806 04:50:01.210002 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:01.210013 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:01.210616 (+ 603us) server_negotiation.cc:407] Connection header received
0806 04:50:01.210991 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:01.211001 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:01.211246 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:01.211412 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:01.212455 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.214241 (+ 1786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.217362 (+ 3121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.218947 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.219052 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.219290 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:01.220237 (+ 947us) server_negotiation.cc:299] Negotiation successful
0806 04:50:01.220445 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":336,"threads_started":1}
I20260806 04:50:01.220794 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.209780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53256 (local address 127.7.113.194:42313)
0806 04:50:01.210416 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:01.210427 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:01.211371 (+ 944us) server_negotiation.cc:407] Connection header received
0806 04:50:01.211665 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:01.211672 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:01.211894 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:01.212067 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:01.213057 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.214568 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.217717 (+ 3149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.219042 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.219130 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.219325 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:01.220220 (+ 895us) server_negotiation.cc:299] Negotiation successful
0806 04:50:01.220434 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":855,"threads_started":1}
I20260806 04:50:01.221634 26058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.209442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:42313 (local address 127.0.0.1:53256)
0806 04:50:01.211258 (+ 1816us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:01.211276 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:01.211475 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:01.212396 (+ 921us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:01.212402 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:01.212429 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:01.212856 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:01.212872 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.214742 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.214748 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:01.217511 (+ 2763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:01.217526 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.219538 (+ 2012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.219546 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:01.219851 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.219982 (+ 131us) client_negotiation.cc:769] Sending connection context
0806 04:50:01.221055 (+ 1073us) client_negotiation.cc:240] Negotiation successful
0806 04:50:01.221262 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1675,"mutex_wait_us":503,"thread_start_us":1786,"threads_started":1}
I20260806 04:50:01.222023 26056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.209214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:46713 (local address 127.0.0.1:41930)
0806 04:50:01.210476 (+ 1262us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:01.210507 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:01.210698 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:01.211761 (+ 1063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:01.211767 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:01.211795 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:01.212240 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:01.212271 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.214422 (+ 2151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.214427 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:01.217122 (+ 2695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:01.217137 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.219494 (+ 2357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.219503 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:01.219852 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.219982 (+ 130us) client_negotiation.cc:769] Sending connection context
0806 04:50:01.221454 (+ 1472us) client_negotiation.cc:240] Negotiation successful
0806 04:50:01.221598 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1006,"mutex_wait_us":103,"thread_start_us":819,"threads_started":1}
I20260806 04:50:01.225914 25847 tablet_service.cc:1467] Processing CreateTablet for tablet 1adf4b9405f140b0b243c2d267dae8a3 (DEFAULT_TABLE table=test-table [id=e9dd661f4fb14ef2b00e7ed13ccbd80e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:01.226452 25715 tablet_service.cc:1467] Processing CreateTablet for tablet 1adf4b9405f140b0b243c2d267dae8a3 (DEFAULT_TABLE table=test-table [id=e9dd661f4fb14ef2b00e7ed13ccbd80e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:01.227267 25847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1adf4b9405f140b0b243c2d267dae8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:01.227710 25715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1adf4b9405f140b0b243c2d267dae8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:01.230526 26056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.211650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:36103 (local address 127.0.0.1:56232)
0806 04:50:01.222465 (+ 10815us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:01.222481 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:01.222570 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:01.223677 (+ 1107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:01.223681 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:01.223707 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:01.223890 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:01.223901 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.226158 (+ 2257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.226163 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:01.227986 (+ 1823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:01.228005 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.229762 (+ 1757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.229770 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:01.229975 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.230009 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 04:50:01.230110 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 04:50:01.230242 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10725,"thread_start_us":11616,"threads_started":1}
I20260806 04:50:01.230707 26061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.212022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56232 (local address 127.7.113.195:36103)
0806 04:50:01.223113 (+ 11091us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:01.223124 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:01.223159 (+ 35us) server_negotiation.cc:407] Connection header received
0806 04:50:01.223251 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:01.223258 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:01.223472 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:01.224068 (+ 596us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:01.224352 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.225961 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.228185 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.229583 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.229728 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.229999 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:01.230161 (+ 162us) server_negotiation.cc:299] Negotiation successful
0806 04:50:01.230329 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10912,"thread_start_us":10753,"threads_started":1}
I20260806 04:50:01.234222 25978 tablet_service.cc:1467] Processing CreateTablet for tablet 1adf4b9405f140b0b243c2d267dae8a3 (DEFAULT_TABLE table=test-table [id=e9dd661f4fb14ef2b00e7ed13ccbd80e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:01.235520 25978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1adf4b9405f140b0b243c2d267dae8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:01.239943 26062 tablet_bootstrap.cc:492] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b: Bootstrap starting.
I20260806 04:50:01.243175 26062 tablet_bootstrap.cc:654] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:01.244143 26062 log.cc:824] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:01.247092 26062 tablet_bootstrap.cc:492] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b: No bootstrap required, opened a new log
I20260806 04:50:01.247438 26062 ts_tablet_manager.cc:1397] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s
I20260806 04:50:01.248345 26063 tablet_bootstrap.cc:492] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551: Bootstrap starting.
I20260806 04:50:01.252375 26063 tablet_bootstrap.cc:654] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:01.253646 26063 log.cc:824] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:01.255633 26065 tablet_bootstrap.cc:492] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96: Bootstrap starting.
I20260806 04:50:01.259445 26062 raft_consensus.cc:348] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faaa172d0ea84ce98887e8239c1ce551" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 46713 } } peers { permanent_uuid: "40c0117d0b9b434c98f490e7afafd55b" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 42313 } } peers { permanent_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36103 } }
I20260806 04:50:01.259989 26062 raft_consensus.cc:374] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:01.260093 26062 raft_consensus.cc:729] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40c0117d0b9b434c98f490e7afafd55b, State: Initialized, Role: FOLLOWER
I20260806 04:50:01.260380 26065 tablet_bootstrap.cc:654] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:01.260830 26062 consensus_queue.cc:260] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faaa172d0ea84ce98887e8239c1ce551" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 46713 } } peers { permanent_uuid: "40c0117d0b9b434c98f490e7afafd55b" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 42313 } } peers { permanent_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36103 } }
I20260806 04:50:01.261502 26065 log.cc:824] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:01.265002 26063 tablet_bootstrap.cc:492] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551: No bootstrap required, opened a new log
I20260806 04:50:01.265146 25913 heartbeater.cc:503] Master 127.7.113.254:35881 was elected leader, sending a full tablet report...
I20260806 04:50:01.265311 26063 ts_tablet_manager.cc:1397] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.000s
I20260806 04:50:01.265864 26062 ts_tablet_manager.cc:1428] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b: Time spent starting tablet: real 0.018s user 0.018s sys 0.001s
I20260806 04:50:01.267491 26065 tablet_bootstrap.cc:492] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96: No bootstrap required, opened a new log
I20260806 04:50:01.267769 26065 ts_tablet_manager.cc:1397] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.006s
I20260806 04:50:01.272701 25781 heartbeater.cc:503] Master 127.7.113.254:35881 was elected leader, sending a full tablet report...
I20260806 04:50:01.275452 26063 raft_consensus.cc:348] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faaa172d0ea84ce98887e8239c1ce551" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 46713 } } peers { permanent_uuid: "40c0117d0b9b434c98f490e7afafd55b" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 42313 } } peers { permanent_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36103 } }
I20260806 04:50:01.275903 26063 raft_consensus.cc:374] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:01.275612 26065 raft_consensus.cc:348] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faaa172d0ea84ce98887e8239c1ce551" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 46713 } } peers { permanent_uuid: "40c0117d0b9b434c98f490e7afafd55b" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 42313 } } peers { permanent_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36103 } }
I20260806 04:50:01.276013 26063 raft_consensus.cc:729] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faaa172d0ea84ce98887e8239c1ce551, State: Initialized, Role: FOLLOWER
I20260806 04:50:01.276063 26065 raft_consensus.cc:374] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:01.276162 26065 raft_consensus.cc:729] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6af51bfde15b4a9e9c226a2cdb0dbc96, State: Initialized, Role: FOLLOWER
I20260806 04:50:01.276789 26063 consensus_queue.cc:260] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faaa172d0ea84ce98887e8239c1ce551" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 46713 } } peers { permanent_uuid: "40c0117d0b9b434c98f490e7afafd55b" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 42313 } } peers { permanent_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36103 } }
I20260806 04:50:01.277115 26065 consensus_queue.cc:260] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faaa172d0ea84ce98887e8239c1ce551" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 46713 } } peers { permanent_uuid: "40c0117d0b9b434c98f490e7afafd55b" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 42313 } } peers { permanent_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36103 } }
I20260806 04:50:01.277426 26069 raft_consensus.cc:482] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:50:01.277694 26069 raft_consensus.cc:504] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faaa172d0ea84ce98887e8239c1ce551" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 46713 } } peers { permanent_uuid: "40c0117d0b9b434c98f490e7afafd55b" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 42313 } } peers { permanent_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36103 } }
I20260806 04:50:01.278774 26063 ts_tablet_manager.cc:1428] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551: Time spent starting tablet: real 0.013s user 0.003s sys 0.008s
I20260806 04:50:01.279593 26069 leader_election.cc:288] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers faaa172d0ea84ce98887e8239c1ce551 (127.7.113.193:46713), 40c0117d0b9b434c98f490e7afafd55b (127.7.113.194:42313)
I20260806 04:50:01.280122 26044 heartbeater.cc:503] Master 127.7.113.254:35881 was elected leader, sending a full tablet report...
I20260806 04:50:01.286316 26065 ts_tablet_manager.cc:1428] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96: Time spent starting tablet: real 0.018s user 0.003s sys 0.015s
I20260806 04:50:01.290354 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.280894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:33459 (local address 127.7.113.194:42313)
0806 04:50:01.282139 (+ 1245us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:01.282148 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:01.282174 (+ 26us) server_negotiation.cc:407] Connection header received
0806 04:50:01.282271 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:01.282279 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:01.282374 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:01.282486 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:01.283440 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.284941 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.288228 (+ 3287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.289517 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.289690 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.289766 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:01.290086 (+ 320us) server_negotiation.cc:299] Negotiation successful
0806 04:50:01.290175 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1064}
I20260806 04:50:01.290443 26046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.279856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:42313 (local address 127.7.113.195:33459)
0806 04:50:01.280315 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:01.280340 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:01.280488 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:01.282695 (+ 2207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:01.282703 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:01.282737 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:01.283030 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:01.283044 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.285150 (+ 2106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.285158 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:01.288051 (+ 2893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:01.288072 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.289693 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.289701 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:01.289902 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.289943 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 04:50:01.290044 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 04:50:01.290182 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279}
I20260806 04:50:01.291343 25868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1adf4b9405f140b0b243c2d267dae8a3" candidate_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40c0117d0b9b434c98f490e7afafd55b" is_pre_election: true
I20260806 04:50:01.291808 25868 raft_consensus.cc:2454] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6af51bfde15b4a9e9c226a2cdb0dbc96 in term 0.
I20260806 04:50:01.292472 25931 leader_election.cc:302] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40c0117d0b9b434c98f490e7afafd55b, 6af51bfde15b4a9e9c226a2cdb0dbc96; no voters:
I20260806 04:50:01.292862 26069 raft_consensus.cc:2781] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:50:01.293017 26069 raft_consensus.cc:482] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:50:01.293123 26069 raft_consensus.cc:3037] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:01.294466 26057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.280567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:52121 (local address 127.7.113.193:46713)
0806 04:50:01.280786 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:01.280795 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:01.288962 (+ 8167us) server_negotiation.cc:407] Connection header received
0806 04:50:01.289112 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:01.289116 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:01.289180 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:01.289257 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:01.289895 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.290845 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.292599 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.293584 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.293758 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.293819 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:01.294101 (+ 282us) server_negotiation.cc:299] Negotiation successful
0806 04:50:01.294217 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 04:50:01.294553 26072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.279909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:46713 (local address 127.7.113.195:52121)
0806 04:50:01.288860 (+ 8951us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:01.288877 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:01.288993 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:01.289290 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:01.289295 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:01.289319 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:01.289719 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:01.289732 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.290983 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.290988 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:01.292419 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:01.292431 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.293766 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.293772 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:01.293943 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.293968 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 04:50:01.294077 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 04:50:01.294208 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8838,"thread_start_us":8528,"threads_started":1}
I20260806 04:50:01.295461 26069 raft_consensus.cc:504] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faaa172d0ea84ce98887e8239c1ce551" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 46713 } } peers { permanent_uuid: "40c0117d0b9b434c98f490e7afafd55b" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 42313 } } peers { permanent_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36103 } }
I20260806 04:50:01.295439 25736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1adf4b9405f140b0b243c2d267dae8a3" candidate_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faaa172d0ea84ce98887e8239c1ce551" is_pre_election: true
I20260806 04:50:01.295924 25736 raft_consensus.cc:2454] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6af51bfde15b4a9e9c226a2cdb0dbc96 in term 0.
I20260806 04:50:01.296108 26069 leader_election.cc:288] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [CANDIDATE]: Term 1 election: Requested vote from peers faaa172d0ea84ce98887e8239c1ce551 (127.7.113.193:46713), 40c0117d0b9b434c98f490e7afafd55b (127.7.113.194:42313)
I20260806 04:50:01.296540 25735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1adf4b9405f140b0b243c2d267dae8a3" candidate_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faaa172d0ea84ce98887e8239c1ce551"
I20260806 04:50:01.296605 25868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1adf4b9405f140b0b243c2d267dae8a3" candidate_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40c0117d0b9b434c98f490e7afafd55b"
I20260806 04:50:01.296799 25868 raft_consensus.cc:3037] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:01.296789 25735 raft_consensus.cc:3037] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:01.299006 25735 raft_consensus.cc:2454] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6af51bfde15b4a9e9c226a2cdb0dbc96 in term 1.
I20260806 04:50:01.299103 25868 raft_consensus.cc:2454] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6af51bfde15b4a9e9c226a2cdb0dbc96 in term 1.
I20260806 04:50:01.299474 25933 leader_election.cc:302] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6af51bfde15b4a9e9c226a2cdb0dbc96, faaa172d0ea84ce98887e8239c1ce551; no voters:
I20260806 04:50:01.299808 26069 raft_consensus.cc:2781] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:01.299978 26069 raft_consensus.cc:686] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [term 1 LEADER]: Becoming Leader. State: Replica: 6af51bfde15b4a9e9c226a2cdb0dbc96, State: Running, Role: LEADER
I20260806 04:50:01.300451 26069 consensus_queue.cc:237] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faaa172d0ea84ce98887e8239c1ce551" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 46713 } } peers { permanent_uuid: "40c0117d0b9b434c98f490e7afafd55b" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 42313 } } peers { permanent_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36103 } }
I20260806 04:50:01.304644 25593 catalog_manager.cc:5495] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6af51bfde15b4a9e9c226a2cdb0dbc96 (127.7.113.195). New cstate: current_term: 1 leader_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faaa172d0ea84ce98887e8239c1ce551" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 46713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40c0117d0b9b434c98f490e7afafd55b" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 42313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6af51bfde15b4a9e9c226a2cdb0dbc96" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 36103 } health_report { overall_health: HEALTHY } } }
I20260806 04:50:01.335786 26061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.330411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56234 (local address 127.7.113.195:36103)
0806 04:50:01.330607 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:01.330613 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:01.330631 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:50:01.330858 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:01.330862 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:01.330930 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:01.331087 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:50:01.331449 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.332152 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.333600 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.334046 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.334200 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.334746 (+ 546us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:50:01.335190 (+ 444us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:50:01.335346 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:01.335438 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 04:50:01.335512 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 04:50:01.343432 25868 raft_consensus.cc:1261] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b [term 1 FOLLOWER]: Refusing update from remote peer 6af51bfde15b4a9e9c226a2cdb0dbc96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:50:01.343432 25735 raft_consensus.cc:1261] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551 [term 1 FOLLOWER]: Refusing update from remote peer 6af51bfde15b4a9e9c226a2cdb0dbc96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:50:01.344465 26071 consensus_queue.cc:1035] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40c0117d0b9b434c98f490e7afafd55b" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 42313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:50:01.344813 26069 consensus_queue.cc:1035] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faaa172d0ea84ce98887e8239c1ce551" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 46713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:50:01.356302 26076 mvcc.cc:205] Tried to move back new op lower bound from 7315422418292973568 to 7315422418130722816. Current Snapshot: MvccSnapshot[applied={T|T < 7315422418292973568}]
I20260806 04:50:01.362121 26077 mvcc.cc:205] Tried to move back new op lower bound from 7315422418292973568 to 7315422418130722816. Current Snapshot: MvccSnapshot[applied={T|T < 7315422418292973568}]
I20260806 04:50:01.371076 25593 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58958:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:50:01.371321 25593 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58958:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:50:01.374643 25593 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ed4c6639008945908d10ad030b4c23f5: Sending DeleteTablet for 3 replicas of tablet 1adf4b9405f140b0b243c2d267dae8a3
I20260806 04:50:01.375653 25715 tablet_service.cc:1514] Processing DeleteTablet for tablet 1adf4b9405f140b0b243c2d267dae8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:01 UTC) from {username='slave'} at 127.0.0.1:41930
I20260806 04:50:01.375752 25847 tablet_service.cc:1514] Processing DeleteTablet for tablet 1adf4b9405f140b0b243c2d267dae8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:01 UTC) from {username='slave'} at 127.0.0.1:53256
I20260806 04:50:01.377907 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 25653
I20260806 04:50:01.381139 26085 tablet_replica.cc:330] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551: stopping tablet replica
I20260806 04:50:01.381335 26086 tablet_replica.cc:330] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b: stopping tablet replica
I20260806 04:50:01.381554 26085 raft_consensus.cc:2229] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:50:01.381745 26086 raft_consensus.cc:2229] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:50:01.381815 25978 tablet_service.cc:1514] Processing DeleteTablet for tablet 1adf4b9405f140b0b243c2d267dae8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:01 UTC) from {username='slave'} at 127.0.0.1:56232
I20260806 04:50:01.382068 26085 raft_consensus.cc:2258] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:01.382184 26086 raft_consensus.cc:2258] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:01.384188 26085 ts_tablet_manager.cc:1905] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:01.384524 26086 ts_tablet_manager.cc:1905] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:01.390944 26057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.380124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41938 (local address 127.7.113.193:46713)
0806 04:50:01.380373 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:01.380382 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:01.380523 (+ 141us) server_negotiation.cc:407] Connection header received
0806 04:50:01.380848 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:01.380856 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:01.380985 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:01.381065 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:01.382108 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.383817 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.386670 (+ 2853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.387564 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.387667 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.389284 (+ 1617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:01.389295 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:01.389313 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:01.390032 (+ 719us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:01.390094 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:01.390117 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:01.390203 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:01.390448 (+ 245us) server_negotiation.cc:299] Negotiation successful
0806 04:50:01.390557 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 04:50:01.391355 26085 ts_tablet_manager.cc:1918] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:50:01.391337 26086 ts_tablet_manager.cc:1918] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:50:01.391500 26086 log.cc:1196] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/1adf4b9405f140b0b243c2d267dae8a3
I20260806 04:50:01.391500 26085 log.cc:1196] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/1adf4b9405f140b0b243c2d267dae8a3
I20260806 04:50:01.392117 26086 ts_tablet_manager.cc:1939] T 1adf4b9405f140b0b243c2d267dae8a3 P 40c0117d0b9b434c98f490e7afafd55b: Deleting consensus metadata
I20260806 04:50:01.392351 25776 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:01.393652 25577 catalog_manager.cc:4841] TS 40c0117d0b9b434c98f490e7afafd55b (127.7.113.194:42313): tablet 1adf4b9405f140b0b243c2d267dae8a3 (table test-table [id=e9dd661f4fb14ef2b00e7ed13ccbd80e]) successfully deleted
I20260806 04:50:01.400417 26088 tablet_replica.cc:330] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96: stopping tablet replica
I20260806 04:50:01.400887 26088 raft_consensus.cc:2229] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:50:01.401650 26088 raft_consensus.cc:2258] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:01.403911 26088 ts_tablet_manager.cc:1905] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:01.412496 26088 ts_tablet_manager.cc:1918] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:50:01.412647 26088 log.cc:1196] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/1adf4b9405f140b0b243c2d267dae8a3
I20260806 04:50:01.413167 26088 ts_tablet_manager.cc:1939] T 1adf4b9405f140b0b243c2d267dae8a3 P 6af51bfde15b4a9e9c226a2cdb0dbc96: Deleting consensus metadata
I20260806 04:50:01.414834 25579 catalog_manager.cc:4841] TS 6af51bfde15b4a9e9c226a2cdb0dbc96 (127.7.113.195:36103): tablet 1adf4b9405f140b0b243c2d267dae8a3 (table test-table [id=e9dd661f4fb14ef2b00e7ed13ccbd80e]) successfully deleted
I20260806 04:50:01.489966 26085 ts_tablet_manager.cc:1939] T 1adf4b9405f140b0b243c2d267dae8a3 P faaa172d0ea84ce98887e8239c1ce551: Deleting consensus metadata
I20260806 04:50:01.490659 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 25653
W20260806 04:50:01.509929 25579 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.113.193:46713 (error 108)
I20260806 04:50:01.510635 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 25785
I20260806 04:50:01.512037 26056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.511427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:46713 (local address 127.0.0.1:41948)
0806 04:50:01.511725 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:01.511846 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:46713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
W20260806 04:50:01.512404 25579 catalog_manager.cc:4584] TS faaa172d0ea84ce98887e8239c1ce551 (127.7.113.193:46713): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1adf4b9405f140b0b243c2d267dae8a3: Network error: Client connection negotiation failed: client connection to 127.7.113.193:46713: connect: Connection refused (error 111)
I20260806 04:50:01.517959 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.511529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53264 (local address 127.7.113.194:42313)
0806 04:50:01.511708 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:01.511714 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:01.511848 (+ 134us) server_negotiation.cc:407] Connection header received
0806 04:50:01.512062 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:01.512074 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:01.512200 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:01.512333 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:01.512898 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.513624 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.514939 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.515337 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.515474 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.516606 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:01.516615 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:01.516629 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:01.517208 (+ 579us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:01.517253 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:01.517271 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:01.517389 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:01.517518 (+ 129us) server_negotiation.cc:299] Negotiation successful
0806 04:50:01.517629 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 04:50:01.518630 25908 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:01.566278 26056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.565702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:46713 (local address 127.0.0.1:41964)
0806 04:50:01.565941 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:01.566052 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:46713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260806 04:50:01.567490 26056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.567031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:46713 (local address 127.0.0.1:41978)
0806 04:50:01.567210 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:01.567301 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:46713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 04:50:01.608407 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 25785
I20260806 04:50:01.627595 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 25916
I20260806 04:50:01.628407 26056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.627870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:46713 (local address 127.0.0.1:41984)
0806 04:50:01.628103 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:01.628210 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:46713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260806 04:50:01.629710 26056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.629238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:46713 (local address 127.0.0.1:41998)
0806 04:50:01.629459 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:01.629540 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:46713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
I20260806 04:50:01.635871 26061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.628406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56250 (local address 127.7.113.195:36103)
0806 04:50:01.628613 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:01.628619 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:01.628882 (+ 263us) server_negotiation.cc:407] Connection header received
0806 04:50:01.628975 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:01.628980 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:01.629088 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:01.629216 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:01.629718 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.630942 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.632215 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:01.632927 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:01.633060 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:01.634183 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:01.634195 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:01.634213 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:01.635058 (+ 845us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:01.635123 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:01.635157 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:01.635275 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:01.635391 (+ 116us) server_negotiation.cc:299] Negotiation successful
0806 04:50:01.635493 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 04:50:01.636720 26039 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:01.710210 26056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.709768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:46713 (local address 127.0.0.1:42014)
0806 04:50:01.709984 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:01.710069 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:46713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260806 04:50:01.711239 26056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.710837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:46713 (local address 127.0.0.1:42018)
0806 04:50:01.711035 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:01.711110 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:46713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260806 04:50:01.758365 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 25916
I20260806 04:50:01.776571 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 25561
I20260806 04:50:01.777684 25623 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:01.885977 26056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:01.885066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:46713 (local address 127.0.0.1:42026)
0806 04:50:01.885293 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:01.885378 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:46713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260806 04:50:01.885954 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 25561
2026-08-06T04:50:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2689 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:02 dist-test-slave-0b58 krb5kdc[26096](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:02 dist-test-slave-0b58 krb5kdc[26096](info): set up 2 sockets
Aug 06 04:50:02 dist-test-slave-0b58 krb5kdc[26096](info): commencing operation
krb5kdc: starting...
W20260806 04:50:03.018250 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.001s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:03 dist-test-slave-0b58 krb5kdc[26096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:50:03.308975 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:45353
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:44937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:45353
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:03.635434 26109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:03.635699 26109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:03.635818 26109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:03.643069 26109 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:03.643167 26109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:03.643275 26109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:03.643375 26109 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:03.643455 26109 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:03.653306 26109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:44937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:45353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:45353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:03.654615 26109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:03.655918 26109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:03.667567 26114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:03.667832 26117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:03.667788 26115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:03.668809 26109 server_base.cc:1034] running on GCE node
I20260806 04:50:03.669559 26109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:03.670895 26109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:03.672113 26109 hybrid_clock.cc:648] HybridClock initialized: now 1785991803672059 us; error 57 us; skew 500 ppm
I20260806 04:50:03.672500 26109 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:03 dist-test-slave-0b58 krb5kdc[26096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991803, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:03.675560 26109 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:50:03.677040 26109 webserver.cc:460] Webserver started at http://127.7.113.254:43423/ using document root <none> and password file <none>
I20260806 04:50:03.677706 26109 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:03.677855 26109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:03.678164 26109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:03.681085 26109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "cb106724cf5d4ed1af4ae759b9760336"
format_stamp: "Formatted at 2026-08-06 04:50:03 on dist-test-slave-0b58"
server_key: "c7cb7c6bac8c7d975a3a92cb4854375f"
server_key_iv: "b9d6e82706251547b7a96ee671c4f5d0"
server_key_version: "encryptionkey@0"
I20260806 04:50:03.681842 26109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "cb106724cf5d4ed1af4ae759b9760336"
format_stamp: "Formatted at 2026-08-06 04:50:03 on dist-test-slave-0b58"
server_key: "c7cb7c6bac8c7d975a3a92cb4854375f"
server_key_iv: "b9d6e82706251547b7a96ee671c4f5d0"
server_key_version: "encryptionkey@0"
I20260806 04:50:03.686786 26109 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:50:03.690042 26124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:03.691255 26109 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 04:50:03.691448 26109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "cb106724cf5d4ed1af4ae759b9760336"
format_stamp: "Formatted at 2026-08-06 04:50:03 on dist-test-slave-0b58"
server_key: "c7cb7c6bac8c7d975a3a92cb4854375f"
server_key_iv: "b9d6e82706251547b7a96ee671c4f5d0"
server_key_version: "encryptionkey@0"
I20260806 04:50:03.691666 26109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:03.705333 26109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:03.709501 26109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:03.709772 26109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:03.727780 26109 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:45353
I20260806 04:50:03.727818 26175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:45353 every 8 connection(s)
I20260806 04:50:03.729112 26109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:03.732686 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 26109
I20260806 04:50:03.732722 26176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:03.732878 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:03.733477 7623 external_mini_cluster.cc:1428] Setting key ede1564186a657bd7010b8e1627e1d75
I20260806 04:50:03.746925 26176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336: Bootstrap starting.
Aug 06 04:50:03 dist-test-slave-0b58 krb5kdc[26096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:50:03.750496 26176 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:03.751838 26176 log.cc:824] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:03.754878 26176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336: No bootstrap required, opened a new log
I20260806 04:50:03.757131 26179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:03.735277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34260 (local address 127.7.113.254:45353)
0806 04:50:03.736104 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:03.736117 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:03.736158 (+ 41us) server_negotiation.cc:407] Connection header received
0806 04:50:03.737729 (+ 1571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:03.737748 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:03.738104 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:03.738406 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:03.740219 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:03.741513 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:03.743391 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:03.744041 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:03.744172 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:03.748985 (+ 4813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:03.748996 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:03.749012 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:03.749052 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:03.752883 (+ 3831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:03.753573 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:03.753583 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:03.753592 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:03.753803 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:03.754147 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:03.754152 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:03.754155 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:03.754815 (+ 660us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:03.755082 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:03.755499 (+ 417us) server_negotiation.cc:299] Negotiation successful
0806 04:50:03.755894 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":405,"threads_started":1}
I20260806 04:50:03.764148 26176 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb106724cf5d4ed1af4ae759b9760336" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45353 } }
I20260806 04:50:03.764606 26176 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:03.764719 26176 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb106724cf5d4ed1af4ae759b9760336, State: Initialized, Role: FOLLOWER
I20260806 04:50:03.765295 26176 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb106724cf5d4ed1af4ae759b9760336" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45353 } }
I20260806 04:50:03.765524 26176 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:03.765647 26176 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:03.765823 26176 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:03.767907 26176 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb106724cf5d4ed1af4ae759b9760336" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45353 } }
I20260806 04:50:03.768450 26176 leader_election.cc:302] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb106724cf5d4ed1af4ae759b9760336; no voters:
I20260806 04:50:03.768992 26176 leader_election.cc:288] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:03.769131 26181 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:03.769884 26181 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [term 1 LEADER]: Becoming Leader. State: Replica: cb106724cf5d4ed1af4ae759b9760336, State: Running, Role: LEADER
I20260806 04:50:03.770397 26181 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb106724cf5d4ed1af4ae759b9760336" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45353 } }
I20260806 04:50:03.771267 26176 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:03.773393 26183 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb106724cf5d4ed1af4ae759b9760336. Latest consensus state: current_term: 1 leader_uuid: "cb106724cf5d4ed1af4ae759b9760336" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb106724cf5d4ed1af4ae759b9760336" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45353 } } }
I20260806 04:50:03.773597 26182 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb106724cf5d4ed1af4ae759b9760336" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb106724cf5d4ed1af4ae759b9760336" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45353 } } }
I20260806 04:50:03.773864 26182 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:03.773873 26183 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:03.774679 26188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:03.779903 26188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:03.789193 26188 catalog_manager.cc:1347] Generated new cluster ID: 26c65937a9324930a98247fc3c6d4540
I20260806 04:50:03.789294 26188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:03.816197 26188 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:03.817986 26188 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:03.827239 26188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336: Generated new TSK 0
I20260806 04:50:03.828181 26188 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:50:03.901295 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45353
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:44937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:04.235188 26202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:04.235476 26202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:04.235603 26202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:04.249220 26202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:04.249450 26202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:04.249667 26202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:50:04.262676 26202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:44937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:04.263972 26202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:04.265362 26202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:04.278275 26207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:04.278326 26208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:04.278350 26210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:04.278995 26202 server_base.cc:1034] running on GCE node
I20260806 04:50:04.279645 26202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:04.280588 26202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:04.281814 26202 hybrid_clock.cc:648] HybridClock initialized: now 1785991804281772 us; error 37 us; skew 500 ppm
I20260806 04:50:04.282114 26202 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:04 dist-test-slave-0b58 krb5kdc[26096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991804, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:04.285251 26202 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:50:04.286633 26202 webserver.cc:460] Webserver started at http://127.7.113.193:33477/ using document root <none> and password file <none>
I20260806 04:50:04.287264 26202 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:04.287415 26202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:04.287725 26202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:04.290557 26202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "60d829d9e45e4e5d97cdec40fad2207c"
format_stamp: "Formatted at 2026-08-06 04:50:04 on dist-test-slave-0b58"
server_key: "018010f3eeaebf5904905d4fbb2cf3e8"
server_key_iv: "53b6be907fe2c6f522c7fa0b4618f710"
server_key_version: "encryptionkey@0"
I20260806 04:50:04.291324 26202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "60d829d9e45e4e5d97cdec40fad2207c"
format_stamp: "Formatted at 2026-08-06 04:50:04 on dist-test-slave-0b58"
server_key: "018010f3eeaebf5904905d4fbb2cf3e8"
server_key_iv: "53b6be907fe2c6f522c7fa0b4618f710"
server_key_version: "encryptionkey@0"
I20260806 04:50:04.296212 26202 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.006s
I20260806 04:50:04.299422 26217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:04.300740 26202 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:50:04.300907 26202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "60d829d9e45e4e5d97cdec40fad2207c"
format_stamp: "Formatted at 2026-08-06 04:50:04 on dist-test-slave-0b58"
server_key: "018010f3eeaebf5904905d4fbb2cf3e8"
server_key_iv: "53b6be907fe2c6f522c7fa0b4618f710"
server_key_version: "encryptionkey@0"
I20260806 04:50:04.301105 26202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:04.313805 26202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:04.317817 26202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:04.318102 26202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:04.318984 26202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:04.320240 26202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:04.320418 26202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:04.320566 26202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:04.320637 26202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:04.353413 26202 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:34323
I20260806 04:50:04.353456 26329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:34323 every 8 connection(s)
I20260806 04:50:04.354687 26202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:50:04.357406 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 26202
I20260806 04:50:04.357605 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:50:04.358146 7623 external_mini_cluster.cc:1428] Setting key 2baa3ad9c48495732eba77659106d9c2
Aug 06 04:50:04 dist-test-slave-0b58 krb5kdc[26096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991804, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:50:04.376178 26332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:04.357352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:38785 (local address 127.7.113.254:45353)
0806 04:50:04.357808 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:04.357813 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:04.358983 (+ 1170us) server_negotiation.cc:407] Connection header received
0806 04:50:04.360996 (+ 2013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:04.361004 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:04.361091 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:04.361209 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:04.362579 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:04.363735 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:04.365451 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:04.366199 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:04.366355 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:04.370137 (+ 3782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:04.370142 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:04.370145 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:04.370177 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:04.373005 (+ 2828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:04.373686 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:04.373694 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:04.373698 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:04.373865 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:04.374280 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:04.374287 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:04.374292 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:04.374645 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:04.374795 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:04.375430 (+ 635us) server_negotiation.cc:299] Negotiation successful
0806 04:50:04.375685 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":233,"threads_started":1}
I20260806 04:50:04.376727 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:04.357991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45353 (local address 127.7.113.193:38785)
0806 04:50:04.358776 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:04.358833 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:04.360737 (+ 1904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:04.361388 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:04.361396 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:04.361880 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:04.362406 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:04.362422 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:04.363898 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:04.363901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:04.365273 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:04.365304 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:04.366410 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:04.366415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:04.366598 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:04.367274 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:04.367295 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:04.369927 (+ 2632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:04.373137 (+ 3210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:04.373143 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:04.373154 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:04.373553 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:04.373976 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:04.373979 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:04.373981 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:04.374146 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:04.374768 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:04.374773 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:04.375046 (+ 273us) client_negotiation.cc:769] Sending connection context
0806 04:50:04.375267 (+ 221us) client_negotiation.cc:240] Negotiation successful
0806 04:50:04.375617 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":331,"threads_started":1}
I20260806 04:50:04.378270 26330 heartbeater.cc:347] Connected to a master server at 127.7.113.254:45353
I20260806 04:50:04.378577 26330 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:04.379258 26330 heartbeater.cc:511] Master 127.7.113.254:45353 requested a full tablet report, sending...
I20260806 04:50:04.381480 26141 ts_manager.cc:194] Registered new tserver with Master: 60d829d9e45e4e5d97cdec40fad2207c (127.7.113.193:34323)
I20260806 04:50:04.382972 26141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:38785
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:50:04.423892 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45353
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:44937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:04.749619 26336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:04.749892 26336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:04.750062 26336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:04.757318 26336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:04.757426 26336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:04.757633 26336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:50:04.767588 26336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:44937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:04.768908 26336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:04.770229 26336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:04.783743 26341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:04.783717 26342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:04.783802 26344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:04.784559 26336 server_base.cc:1034] running on GCE node
I20260806 04:50:04.785104 26336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:04.785930 26336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:04.787115 26336 hybrid_clock.cc:648] HybridClock initialized: now 1785991804787031 us; error 80 us; skew 500 ppm
I20260806 04:50:04.787384 26336 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:04 dist-test-slave-0b58 krb5kdc[26096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991804, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:04.795466 26336 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:50:04.796972 26336 webserver.cc:460] Webserver started at http://127.7.113.194:38979/ using document root <none> and password file <none>
I20260806 04:50:04.797606 26336 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:04.797734 26336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:04.797987 26336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:04.801059 26336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "f3c43ade72f64bf7a062953ca93ab398"
format_stamp: "Formatted at 2026-08-06 04:50:04 on dist-test-slave-0b58"
server_key: "3b042c42abf1c41750c530a8e391009c"
server_key_iv: "f6e596071a46cd77256288b7f04da968"
server_key_version: "encryptionkey@0"
I20260806 04:50:04.801792 26336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "f3c43ade72f64bf7a062953ca93ab398"
format_stamp: "Formatted at 2026-08-06 04:50:04 on dist-test-slave-0b58"
server_key: "3b042c42abf1c41750c530a8e391009c"
server_key_iv: "f6e596071a46cd77256288b7f04da968"
server_key_version: "encryptionkey@0"
I20260806 04:50:04.807034 26336 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 04:50:04.810684 26351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:04.811981 26336 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:50:04.812175 26336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "f3c43ade72f64bf7a062953ca93ab398"
format_stamp: "Formatted at 2026-08-06 04:50:04 on dist-test-slave-0b58"
server_key: "3b042c42abf1c41750c530a8e391009c"
server_key_iv: "f6e596071a46cd77256288b7f04da968"
server_key_version: "encryptionkey@0"
I20260806 04:50:04.812458 26336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:04.831488 26336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:04.835156 26336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:04.835455 26336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:04.836426 26336 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:04.837647 26336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:04.837718 26336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:04.837886 26336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:04.837939 26336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:04.871307 26336 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:38667
I20260806 04:50:04.871330 26464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:38667 every 8 connection(s)
I20260806 04:50:04.872781 26336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:50:04.880087 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 26336
I20260806 04:50:04.880321 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:50:04.880844 7623 external_mini_cluster.cc:1428] Setting key 112e066881dbee3d7aef1a82c9bb2ab6
Aug 06 04:50:04 dist-test-slave-0b58 krb5kdc[26096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991804, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:50:04.893532 26332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:04.875287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:56289 (local address 127.7.113.254:45353)
0806 04:50:04.875502 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:04.875506 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:04.876705 (+ 1199us) server_negotiation.cc:407] Connection header received
0806 04:50:04.878500 (+ 1795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:04.878506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:04.878597 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:04.878706 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:04.880148 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:04.881089 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:04.882965 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:04.883402 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:04.883548 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:04.887448 (+ 3900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:04.887453 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:04.887456 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:04.887487 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:04.890093 (+ 2606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:04.891014 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:04.891018 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:04.891020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:04.891136 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:04.891590 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:04.891593 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:04.891595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:04.891835 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:04.891952 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:04.892882 (+ 930us) server_negotiation.cc:299] Negotiation successful
0806 04:50:04.893122 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 04:50:04.894807 26467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:04.875799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45353 (local address 127.7.113.194:56289)
0806 04:50:04.876548 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:04.876586 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:04.878239 (+ 1653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:04.878936 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:04.878944 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:04.879424 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:04.879979 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:04.879995 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:04.881278 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:04.881285 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:04.882823 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:04.882835 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:04.883646 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:04.883654 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:04.883876 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:04.884585 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:04.884611 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:04.887214 (+ 2603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:04.890240 (+ 3026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:04.890251 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:04.890269 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:04.890906 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:04.891240 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:04.891247 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:04.891254 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:04.891485 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:04.891966 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:04.891976 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:04.892469 (+ 493us) client_negotiation.cc:769] Sending connection context
0806 04:50:04.892788 (+ 319us) client_negotiation.cc:240] Negotiation successful
0806 04:50:04.893358 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":289,"threads_started":1}
I20260806 04:50:04.896471 26465 heartbeater.cc:347] Connected to a master server at 127.7.113.254:45353
I20260806 04:50:04.896776 26465 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:04.897513 26465 heartbeater.cc:511] Master 127.7.113.254:45353 requested a full tablet report, sending...
I20260806 04:50:04.898969 26141 ts_manager.cc:194] Registered new tserver with Master: f3c43ade72f64bf7a062953ca93ab398 (127.7.113.194:38667)
I20260806 04:50:04.899776 26141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:56289
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:50:04.947681 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45353
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:44937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:05.273542 26470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:05.273823 26470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:05.273979 26470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:05.281069 26470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:05.281198 26470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:05.281355 26470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:50:05.290777 26470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:44937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:05.291962 26470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:05.293244 26470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:05.306224 26476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:05.306352 26475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:05.306524 26478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:05.306896 26470 server_base.cc:1034] running on GCE node
I20260806 04:50:05.307487 26470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:05.308439 26470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:05.309669 26470 hybrid_clock.cc:648] HybridClock initialized: now 1785991805309622 us; error 54 us; skew 500 ppm
I20260806 04:50:05.310042 26470 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:05 dist-test-slave-0b58 krb5kdc[26096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991805, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:05.313172 26470 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:50:05.314651 26470 webserver.cc:460] Webserver started at http://127.7.113.195:41281/ using document root <none> and password file <none>
I20260806 04:50:05.315318 26470 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:05.315488 26470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:05.315790 26470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:05.318672 26470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "8f33074393524f3e80af904bce377854"
format_stamp: "Formatted at 2026-08-06 04:50:05 on dist-test-slave-0b58"
server_key: "7b03179390bf8946952f1bd95a818739"
server_key_iv: "8278646cb95da2a42a7029233f614a7a"
server_key_version: "encryptionkey@0"
I20260806 04:50:05.319458 26470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "8f33074393524f3e80af904bce377854"
format_stamp: "Formatted at 2026-08-06 04:50:05 on dist-test-slave-0b58"
server_key: "7b03179390bf8946952f1bd95a818739"
server_key_iv: "8278646cb95da2a42a7029233f614a7a"
server_key_version: "encryptionkey@0"
I20260806 04:50:05.324414 26470 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260806 04:50:05.327634 26485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:05.328923 26470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:50:05.329094 26470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "8f33074393524f3e80af904bce377854"
format_stamp: "Formatted at 2026-08-06 04:50:05 on dist-test-slave-0b58"
server_key: "7b03179390bf8946952f1bd95a818739"
server_key_iv: "8278646cb95da2a42a7029233f614a7a"
server_key_version: "encryptionkey@0"
I20260806 04:50:05.329286 26470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:05.343612 26470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:05.347781 26470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:05.348070 26470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:05.349033 26470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:05.350247 26470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:05.350350 26470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:05.350503 26470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:05.350576 26470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:05.384632 26470 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:43921
I20260806 04:50:05.384709 26598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:43921 every 8 connection(s)
I20260806 04:50:05.385620 26330 heartbeater.cc:503] Master 127.7.113.254:45353 was elected leader, sending a full tablet report...
I20260806 04:50:05.385887 26470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:50:05.394477 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 26470
I20260806 04:50:05.394695 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:50:05.395141 7623 external_mini_cluster.cc:1428] Setting key 51293db9ba95a36cbf0531f370abad13
Aug 06 04:50:05 dist-test-slave-0b58 krb5kdc[26096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991805, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:50:05.405314 26332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.388484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:35887 (local address 127.7.113.254:45353)
0806 04:50:05.388690 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:05.388697 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:05.389806 (+ 1109us) server_negotiation.cc:407] Connection header received
0806 04:50:05.391485 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:05.391489 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:05.391581 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:05.391667 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:05.393105 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.393873 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.395709 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.396368 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.396504 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.400003 (+ 3499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:05.400008 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:05.400011 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:05.400040 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:05.402710 (+ 2670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:05.403338 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:05.403341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:05.403343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:05.403468 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:05.403850 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:05.403854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:05.403857 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:05.404099 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:05.404214 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:05.404914 (+ 700us) server_negotiation.cc:299] Negotiation successful
0806 04:50:05.405086 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 04:50:05.406216 26601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.388990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45353 (local address 127.7.113.195:35887)
0806 04:50:05.389653 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:05.389697 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:05.391246 (+ 1549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:05.391883 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:05.391890 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:05.392436 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:05.392968 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:05.392984 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.393994 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.393997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:05.395537 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:05.395551 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.396634 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.396642 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:05.396942 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.397642 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:05.397690 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:05.399833 (+ 2143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:05.402828 (+ 2995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:05.402833 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:05.402842 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:05.403241 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:05.403556 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:05.403559 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:05.403561 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:05.403763 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:05.404216 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:05.404221 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:05.404530 (+ 309us) client_negotiation.cc:769] Sending connection context
0806 04:50:05.404816 (+ 286us) client_negotiation.cc:240] Negotiation successful
0806 04:50:05.405155 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":257,"threads_started":1}
I20260806 04:50:05.407385 26599 heartbeater.cc:347] Connected to a master server at 127.7.113.254:45353
I20260806 04:50:05.407687 26599 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:05.408461 26599 heartbeater.cc:511] Master 127.7.113.254:45353 requested a full tablet report, sending...
I20260806 04:50:05.409886 26141 ts_manager.cc:194] Registered new tserver with Master: 8f33074393524f3e80af904bce377854 (127.7.113.195:43921)
I20260806 04:50:05.410656 26141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:35887
I20260806 04:50:05.422120 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:50:05.438784 26332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.426086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34268 (local address 127.7.113.254:45353)
0806 04:50:05.426314 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:05.426323 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:05.426644 (+ 321us) server_negotiation.cc:407] Connection header received
0806 04:50:05.426761 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:05.426764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:05.426817 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:05.426894 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:05.428408 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.429096 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.430357 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.430886 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.430976 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.433838 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:05.433843 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:05.433846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:05.433878 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:05.436363 (+ 2485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:05.437008 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:05.437011 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:05.437013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:05.437124 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:05.437461 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:05.437463 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:05.437465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:05.437765 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:05.437982 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:05.438292 (+ 310us) server_negotiation.cc:299] Negotiation successful
0806 04:50:05.438425 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 04:50:05.442317 26141 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34268:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:50:05.448904 26141 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:50:05.473842 26614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.461678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33528 (local address 127.7.113.194:38667)
0806 04:50:05.465253 (+ 3575us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:05.465264 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:05.465299 (+ 35us) server_negotiation.cc:407] Connection header received
0806 04:50:05.465411 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:05.465422 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:05.465704 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:05.466746 (+ 1042us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:05.467438 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.468832 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.471622 (+ 2790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.472677 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.472824 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.473024 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:05.473330 (+ 306us) server_negotiation.cc:299] Negotiation successful
0806 04:50:05.473497 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3399,"thread_start_us":3293,"threads_started":1}
I20260806 04:50:05.474282 26611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.460555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:43921 (local address 127.0.0.1:50484)
0806 04:50:05.462845 (+ 2290us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:05.462887 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:05.463108 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:05.467229 (+ 4121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:05.467234 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:05.467270 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:05.467748 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:05.467764 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.469442 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.469450 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:05.471633 (+ 2183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:05.471648 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.473499 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.473507 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:05.473687 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.473722 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 04:50:05.473793 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 04:50:05.473925 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2003,"mutex_wait_us":62,"thread_start_us":1861,"threads_started":1}
I20260806 04:50:05.473943 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.461185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:38667 (local address 127.0.0.1:33528)
0806 04:50:05.463902 (+ 2717us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:05.463920 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:05.464040 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:05.466767 (+ 2727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:05.466774 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:05.466804 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:05.467226 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:05.467239 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.469016 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.469021 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:05.471466 (+ 2445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:05.471481 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.472925 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.472931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:05.473114 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.473153 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 04:50:05.473289 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 04:50:05.473474 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2571,"mutex_wait_us":26,"thread_start_us":4827,"threads_started":1}
I20260806 04:50:05.474884 26612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.460942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50484 (local address 127.7.113.195:43921)
0806 04:50:05.466721 (+ 5779us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:05.466729 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:05.466771 (+ 42us) server_negotiation.cc:407] Connection header received
0806 04:50:05.466868 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:05.466876 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:05.467061 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:05.467242 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:05.467981 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.469300 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.471854 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.473276 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.474046 (+ 770us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.474275 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:05.474342 (+ 67us) server_negotiation.cc:299] Negotiation successful
0806 04:50:05.474532 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5606,"thread_start_us":5431,"threads_started":1}
I20260806 04:50:05.476224 26613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.461601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:34323 (local address 127.0.0.1:56534)
0806 04:50:05.466400 (+ 4799us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:05.466419 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:05.466547 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:05.468143 (+ 1596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:05.468149 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:05.468183 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:05.468550 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:05.468562 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.470431 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.470436 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:05.472693 (+ 2257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:05.472708 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.475389 (+ 2681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.475396 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:05.475555 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.475597 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 04:50:05.475671 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 04:50:05.475785 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4645,"mutex_wait_us":28,"thread_start_us":2199,"threads_started":1}
I20260806 04:50:05.476835 26615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.462194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56534 (local address 127.7.113.193:34323)
0806 04:50:05.464846 (+ 2652us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:05.464858 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:05.466520 (+ 1662us) server_negotiation.cc:407] Connection header received
0806 04:50:05.466676 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:05.466702 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:05.467671 (+ 969us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:05.467884 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:05.468725 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.470290 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.472893 (+ 2603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.475194 (+ 2301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.475344 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.475554 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:05.475981 (+ 427us) server_negotiation.cc:299] Negotiation successful
0806 04:50:05.476601 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2450,"thread_start_us":2283,"threads_started":1}
I20260806 04:50:05.478457 26534 tablet_service.cc:1467] Processing CreateTablet for tablet 08678a8fe8a445ac9848665bd0666dfc (DEFAULT_TABLE table=test-table [id=531bb04bfabd4f84ba392cf23de4108d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:05.479120 26399 tablet_service.cc:1467] Processing CreateTablet for tablet 08678a8fe8a445ac9848665bd0666dfc (DEFAULT_TABLE table=test-table [id=531bb04bfabd4f84ba392cf23de4108d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:05.479987 26534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08678a8fe8a445ac9848665bd0666dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:05.480319 26399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08678a8fe8a445ac9848665bd0666dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:05.480155 26265 tablet_service.cc:1467] Processing CreateTablet for tablet 08678a8fe8a445ac9848665bd0666dfc (DEFAULT_TABLE table=test-table [id=531bb04bfabd4f84ba392cf23de4108d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:05.481801 26265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08678a8fe8a445ac9848665bd0666dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:05.491398 26617 tablet_bootstrap.cc:492] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398: Bootstrap starting.
I20260806 04:50:05.494197 26618 tablet_bootstrap.cc:492] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854: Bootstrap starting.
I20260806 04:50:05.495903 26617 tablet_bootstrap.cc:654] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:05.495944 26619 tablet_bootstrap.cc:492] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c: Bootstrap starting.
I20260806 04:50:05.497326 26617 log.cc:824] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:05.497974 26618 tablet_bootstrap.cc:654] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:05.498792 26619 tablet_bootstrap.cc:654] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:05.499428 26618 log.cc:824] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:05.499801 26619 log.cc:824] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:05.503185 26619 tablet_bootstrap.cc:492] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c: No bootstrap required, opened a new log
I20260806 04:50:05.503216 26617 tablet_bootstrap.cc:492] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398: No bootstrap required, opened a new log
I20260806 04:50:05.503216 26618 tablet_bootstrap.cc:492] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854: No bootstrap required, opened a new log
I20260806 04:50:05.503451 26619 ts_tablet_manager.cc:1397] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 04:50:05.503455 26617 ts_tablet_manager.cc:1397] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.004s
I20260806 04:50:05.503455 26618 ts_tablet_manager.cc:1397] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260806 04:50:05.510527 26619 raft_consensus.cc:348] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f33074393524f3e80af904bce377854" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43921 } } peers { permanent_uuid: "60d829d9e45e4e5d97cdec40fad2207c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34323 } } peers { permanent_uuid: "f3c43ade72f64bf7a062953ca93ab398" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38667 } }
I20260806 04:50:05.510874 26619 raft_consensus.cc:374] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:05.510994 26619 raft_consensus.cc:729] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d829d9e45e4e5d97cdec40fad2207c, State: Initialized, Role: FOLLOWER
I20260806 04:50:05.511551 26619 consensus_queue.cc:260] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f33074393524f3e80af904bce377854" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43921 } } peers { permanent_uuid: "60d829d9e45e4e5d97cdec40fad2207c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34323 } } peers { permanent_uuid: "f3c43ade72f64bf7a062953ca93ab398" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38667 } }
I20260806 04:50:05.513281 26619 ts_tablet_manager.cc:1428] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260806 04:50:05.513929 26618 raft_consensus.cc:348] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f33074393524f3e80af904bce377854" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43921 } } peers { permanent_uuid: "60d829d9e45e4e5d97cdec40fad2207c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34323 } } peers { permanent_uuid: "f3c43ade72f64bf7a062953ca93ab398" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38667 } }
I20260806 04:50:05.513929 26617 raft_consensus.cc:348] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f33074393524f3e80af904bce377854" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43921 } } peers { permanent_uuid: "60d829d9e45e4e5d97cdec40fad2207c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34323 } } peers { permanent_uuid: "f3c43ade72f64bf7a062953ca93ab398" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38667 } }
I20260806 04:50:05.514333 26617 raft_consensus.cc:374] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:05.514333 26618 raft_consensus.cc:374] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:05.514434 26617 raft_consensus.cc:729] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3c43ade72f64bf7a062953ca93ab398, State: Initialized, Role: FOLLOWER
I20260806 04:50:05.514441 26618 raft_consensus.cc:729] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f33074393524f3e80af904bce377854, State: Initialized, Role: FOLLOWER
I20260806 04:50:05.515015 26618 consensus_queue.cc:260] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f33074393524f3e80af904bce377854" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43921 } } peers { permanent_uuid: "60d829d9e45e4e5d97cdec40fad2207c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34323 } } peers { permanent_uuid: "f3c43ade72f64bf7a062953ca93ab398" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38667 } }
I20260806 04:50:05.515117 26617 consensus_queue.cc:260] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f33074393524f3e80af904bce377854" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43921 } } peers { permanent_uuid: "60d829d9e45e4e5d97cdec40fad2207c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34323 } } peers { permanent_uuid: "f3c43ade72f64bf7a062953ca93ab398" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38667 } }
I20260806 04:50:05.516103 26599 heartbeater.cc:503] Master 127.7.113.254:45353 was elected leader, sending a full tablet report...
I20260806 04:50:05.516988 26618 ts_tablet_manager.cc:1428] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854: Time spent starting tablet: real 0.013s user 0.013s sys 0.001s
I20260806 04:50:05.518033 26465 heartbeater.cc:503] Master 127.7.113.254:45353 was elected leader, sending a full tablet report...
I20260806 04:50:05.518630 26617 ts_tablet_manager.cc:1428] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
W20260806 04:50:05.607044 26331 tablet.cc:2369] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:50:05.624835 26466 tablet.cc:2369] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:50:05.637622 26600 tablet.cc:2369] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:50:05.825155 26624 raft_consensus.cc:482] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:50:05.825441 26624 raft_consensus.cc:504] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f33074393524f3e80af904bce377854" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43921 } } peers { permanent_uuid: "60d829d9e45e4e5d97cdec40fad2207c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34323 } } peers { permanent_uuid: "f3c43ade72f64bf7a062953ca93ab398" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38667 } }
I20260806 04:50:05.827759 26624 leader_election.cc:288] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d829d9e45e4e5d97cdec40fad2207c (127.7.113.193:34323), f3c43ade72f64bf7a062953ca93ab398 (127.7.113.194:38667)
I20260806 04:50:05.833014 26615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.827477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:55875 (local address 127.7.113.193:34323)
0806 04:50:05.827677 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:05.827682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:05.827704 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:50:05.828005 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:05.828018 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:05.828112 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:05.828204 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:05.828810 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.829577 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.831213 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.832071 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.832229 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.832337 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:05.832638 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 04:50:05.832763 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 04:50:05.833014 26601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.827380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:34323 (local address 127.7.113.195:55875)
0806 04:50:05.827645 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:05.827664 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:05.827789 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:05.828311 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:05.828319 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:05.828362 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:05.828661 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:05.828673 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.829713 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.829719 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:05.831054 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:05.831065 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.832210 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.832213 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:05.832444 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.832486 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 04:50:05.832601 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 04:50:05.832731 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":24}
I20260806 04:50:05.834111 26614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.827483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:60893 (local address 127.7.113.194:38667)
0806 04:50:05.827654 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:05.827662 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:05.828836 (+ 1174us) server_negotiation.cc:407] Connection header received
0806 04:50:05.829047 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:05.829051 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:05.829107 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:05.829203 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:05.829688 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.830395 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.832104 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.833249 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.833377 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.833424 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:05.833765 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 04:50:05.833928 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 04:50:05.834232 26626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.828009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:38667 (local address 127.7.113.195:60893)
0806 04:50:05.828736 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:05.828750 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:05.828899 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:05.829218 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:05.829223 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:05.829247 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:05.829533 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:05.829540 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.830553 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.830558 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:05.831914 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:05.831925 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.833443 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.833448 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:05.833619 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.833641 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 04:50:05.833730 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 04:50:05.833848 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"mutex_wait_us":1,"thread_start_us":484,"threads_started":1}
I20260806 04:50:05.834338 26285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08678a8fe8a445ac9848665bd0666dfc" candidate_uuid: "8f33074393524f3e80af904bce377854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d829d9e45e4e5d97cdec40fad2207c" is_pre_election: true
I20260806 04:50:05.834860 26285 raft_consensus.cc:2454] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f33074393524f3e80af904bce377854 in term 0.
I20260806 04:50:05.835290 26419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08678a8fe8a445ac9848665bd0666dfc" candidate_uuid: "8f33074393524f3e80af904bce377854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c43ade72f64bf7a062953ca93ab398" is_pre_election: true
I20260806 04:50:05.835549 26487 leader_election.cc:302] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d829d9e45e4e5d97cdec40fad2207c, 8f33074393524f3e80af904bce377854; no voters:
I20260806 04:50:05.835783 26419 raft_consensus.cc:2454] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f33074393524f3e80af904bce377854 in term 0.
I20260806 04:50:05.835970 26624 raft_consensus.cc:2781] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:50:05.836148 26624 raft_consensus.cc:482] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:50:05.836313 26624 raft_consensus.cc:3037] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:05.838510 26624 raft_consensus.cc:504] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f33074393524f3e80af904bce377854" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43921 } } peers { permanent_uuid: "60d829d9e45e4e5d97cdec40fad2207c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34323 } } peers { permanent_uuid: "f3c43ade72f64bf7a062953ca93ab398" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38667 } }
I20260806 04:50:05.839164 26624 leader_election.cc:288] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [CANDIDATE]: Term 1 election: Requested vote from peers 60d829d9e45e4e5d97cdec40fad2207c (127.7.113.193:34323), f3c43ade72f64bf7a062953ca93ab398 (127.7.113.194:38667)
I20260806 04:50:05.839490 26285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08678a8fe8a445ac9848665bd0666dfc" candidate_uuid: "8f33074393524f3e80af904bce377854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d829d9e45e4e5d97cdec40fad2207c"
I20260806 04:50:05.839676 26285 raft_consensus.cc:3037] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:05.839645 26419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08678a8fe8a445ac9848665bd0666dfc" candidate_uuid: "8f33074393524f3e80af904bce377854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c43ade72f64bf7a062953ca93ab398"
I20260806 04:50:05.839854 26419 raft_consensus.cc:3037] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:05.841921 26285 raft_consensus.cc:2454] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f33074393524f3e80af904bce377854 in term 1.
I20260806 04:50:05.842114 26419 raft_consensus.cc:2454] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f33074393524f3e80af904bce377854 in term 1.
I20260806 04:50:05.842285 26487 leader_election.cc:302] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d829d9e45e4e5d97cdec40fad2207c, 8f33074393524f3e80af904bce377854; no voters:
I20260806 04:50:05.842600 26624 raft_consensus.cc:2781] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:05.843034 26624 raft_consensus.cc:686] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [term 1 LEADER]: Becoming Leader. State: Replica: 8f33074393524f3e80af904bce377854, State: Running, Role: LEADER
I20260806 04:50:05.843525 26624 consensus_queue.cc:237] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f33074393524f3e80af904bce377854" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43921 } } peers { permanent_uuid: "60d829d9e45e4e5d97cdec40fad2207c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34323 } } peers { permanent_uuid: "f3c43ade72f64bf7a062953ca93ab398" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38667 } }
I20260806 04:50:05.848017 26140 catalog_manager.cc:5495] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f33074393524f3e80af904bce377854 (127.7.113.195). New cstate: current_term: 1 leader_uuid: "8f33074393524f3e80af904bce377854" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f33074393524f3e80af904bce377854" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d829d9e45e4e5d97cdec40fad2207c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c43ade72f64bf7a062953ca93ab398" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38667 } health_report { overall_health: UNKNOWN } } }
I20260806 04:50:05.927982 26612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.923174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50496 (local address 127.7.113.195:43921)
0806 04:50:05.923345 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:05.923349 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:05.923432 (+ 83us) server_negotiation.cc:407] Connection header received
0806 04:50:05.923613 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:05.923617 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:05.923691 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:05.923810 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:50:05.924143 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.924892 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.926187 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.926553 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.926639 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.927085 (+ 446us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:50:05.927540 (+ 455us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:50:05.927660 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:05.927755 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 04:50:05.927790 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 04:50:05.935896 26419 raft_consensus.cc:1261] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398 [term 1 FOLLOWER]: Refusing update from remote peer 8f33074393524f3e80af904bce377854: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:50:05.935899 26285 raft_consensus.cc:1261] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c [term 1 FOLLOWER]: Refusing update from remote peer 8f33074393524f3e80af904bce377854: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:50:05.936841 26627 consensus_queue.cc:1035] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c43ade72f64bf7a062953ca93ab398" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:50:05.937160 26624 consensus_queue.cc:1035] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d829d9e45e4e5d97cdec40fad2207c" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 34323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:50:05.960758 26140 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:50:05.961011 26140 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:50:05.964339 26140 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cb106724cf5d4ed1af4ae759b9760336: Sending DeleteTablet for 3 replicas of tablet 08678a8fe8a445ac9848665bd0666dfc
I20260806 04:50:05.965521 26265 tablet_service.cc:1514] Processing DeleteTablet for tablet 08678a8fe8a445ac9848665bd0666dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:05 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:56534
I20260806 04:50:05.965519 26534 tablet_service.cc:1514] Processing DeleteTablet for tablet 08678a8fe8a445ac9848665bd0666dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:05 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:50484
I20260806 04:50:05.966037 26399 tablet_service.cc:1514] Processing DeleteTablet for tablet 08678a8fe8a445ac9848665bd0666dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:05 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:33528
I20260806 04:50:05.968593 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 26202
I20260806 04:50:05.977288 26641 tablet_replica.cc:330] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398: stopping tablet replica
I20260806 04:50:05.977813 26641 raft_consensus.cc:2229] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:50:05.978065 26639 tablet_replica.cc:330] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c: stopping tablet replica
I20260806 04:50:05.978339 26641 raft_consensus.cc:2258] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:05.978452 26639 raft_consensus.cc:2229] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:50:05.978925 26639 raft_consensus.cc:2258] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:05.979221 26640 tablet_replica.cc:330] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854: stopping tablet replica
I20260806 04:50:05.981410 26639 ts_tablet_manager.cc:1905] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:05.979627 26640 raft_consensus.cc:2229] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:50:05.982579 26640 raft_consensus.cc:2258] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:05.981805 26641 ts_tablet_manager.cc:1905] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:05.988621 26639 ts_tablet_manager.cc:1918] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:50:05.988798 26639 log.cc:1196] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/08678a8fe8a445ac9848665bd0666dfc
I20260806 04:50:05.989303 26639 ts_tablet_manager.cc:1939] T 08678a8fe8a445ac9848665bd0666dfc P 60d829d9e45e4e5d97cdec40fad2207c: Deleting consensus metadata
I20260806 04:50:05.989715 26641 ts_tablet_manager.cc:1918] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:50:05.989887 26641 log.cc:1196] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/08678a8fe8a445ac9848665bd0666dfc
I20260806 04:50:05.990439 26641 ts_tablet_manager.cc:1939] T 08678a8fe8a445ac9848665bd0666dfc P f3c43ade72f64bf7a062953ca93ab398: Deleting consensus metadata
I20260806 04:50:05.991786 26640 ts_tablet_manager.cc:1905] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:05.992338 26127 catalog_manager.cc:4841] TS f3c43ade72f64bf7a062953ca93ab398 (127.7.113.194:38667): tablet 08678a8fe8a445ac9848665bd0666dfc (table test-table [id=531bb04bfabd4f84ba392cf23de4108d]) successfully deleted
I20260806 04:50:05.992681 26126 catalog_manager.cc:4841] TS 60d829d9e45e4e5d97cdec40fad2207c (127.7.113.193:34323): tablet 08678a8fe8a445ac9848665bd0666dfc (table test-table [id=531bb04bfabd4f84ba392cf23de4108d]) successfully deleted
Aug 06 04:50:05 dist-test-slave-0b58 krb5kdc[26096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:50:05.998450 26640 ts_tablet_manager.cc:1918] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:50:05.998629 26640 log.cc:1196] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/08678a8fe8a445ac9848665bd0666dfc
I20260806 04:50:05.999114 26640 ts_tablet_manager.cc:1939] T 08678a8fe8a445ac9848665bd0666dfc P 8f33074393524f3e80af904bce377854: Deleting consensus metadata
I20260806 04:50:06.000694 26125 catalog_manager.cc:4841] TS 8f33074393524f3e80af904bce377854 (127.7.113.195:43921): tablet 08678a8fe8a445ac9848665bd0666dfc (table test-table [id=531bb04bfabd4f84ba392cf23de4108d]) successfully deleted
I20260806 04:50:06.004536 26615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:05.969989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56540 (local address 127.7.113.193:34323)
0806 04:50:05.970153 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:05.970158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:05.984072 (+ 13914us) server_negotiation.cc:407] Connection header received
0806 04:50:05.984544 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:05.984551 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:05.984630 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:05.984699 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:05.986516 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.987710 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.990122 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:05.990794 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:05.990952 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:05.997708 (+ 6756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:05.997723 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:05.997742 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:05.997782 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:06.001616 (+ 3834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:06.002287 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:06.002297 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:06.002300 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:06.002461 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:06.002960 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:06.002966 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:06.002971 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:06.003391 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:06.003688 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:06.003860 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 04:50:06.004077 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 04:50:06.005210 26325 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:06.154340 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 26202
I20260806 04:50:06.174618 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 26336
Aug 06 04:50:06 dist-test-slave-0b58 krb5kdc[26096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:50:06.192015 26614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:06.175500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33530 (local address 127.7.113.194:38667)
0806 04:50:06.175666 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:06.175671 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:06.175735 (+ 64us) server_negotiation.cc:407] Connection header received
0806 04:50:06.175919 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:06.175923 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:06.175985 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:06.176104 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:06.177778 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:06.178487 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:06.180582 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:06.181054 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:06.181147 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:06.186196 (+ 5049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:06.186218 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:06.186235 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:06.186267 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:06.189231 (+ 2964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:06.189968 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:06.189976 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:06.189978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:06.190100 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:06.190492 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:06.190496 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:06.190498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:06.190866 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:06.191199 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:06.191451 (+ 252us) server_negotiation.cc:299] Negotiation successful
0806 04:50:06.191668 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 04:50:06.192694 26460 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:06.287046 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 26336
I20260806 04:50:06.306409 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 26470
Aug 06 04:50:06 dist-test-slave-0b58 krb5kdc[26096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:50:06.322605 26612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:06.307245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50504 (local address 127.7.113.195:43921)
0806 04:50:06.307431 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:06.307439 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:06.307529 (+ 90us) server_negotiation.cc:407] Connection header received
0806 04:50:06.307741 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:06.307747 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:06.307825 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:06.307943 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:06.309355 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:06.310221 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:06.311542 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:06.312031 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:06.312175 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:06.316620 (+ 4445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:06.316632 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:06.316649 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:06.316690 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:06.319600 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:06.320398 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:06.320405 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:06.320407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:06.320566 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:06.320962 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:06.320967 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:06.320970 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:06.321344 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:06.321680 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:06.322006 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 04:50:06.322224 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 04:50:06.323401 26594 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:06.443787 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 26470
I20260806 04:50:06.467028 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 26109
I20260806 04:50:06.468138 26171 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:06.577014 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 26109
2026-08-06T04:50:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4692 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-06T04:50:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:06Z Disabled control of system clock
I20260806 04:50:06.664052 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:39849
--webserver_interface=127.7.113.254
--webserver_port=0
--builtin_ntp_servers=127.7.113.212:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:39849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 04:50:06.988912 26650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:06.989173 26650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:06.989264 26650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:06.996054 26650 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:06.996147 26650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:06.996183 26650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:06.996237 26650 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:06.996336 26650 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:07.005187 26650 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:39849
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:39849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:07.006392 26650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:07.008155 26650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:07.020092 26655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:07.019981 26658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:07.019994 26656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:07.021085 26650 server_base.cc:1034] running on GCE node
I20260806 04:50:07.021945 26650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:07.023356 26650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:07.024578 26650 hybrid_clock.cc:648] HybridClock initialized: now 1785991807024539 us; error 52 us; skew 500 ppm
I20260806 04:50:07.024928 26650 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:50:07.027168 26650 webserver.cc:460] Webserver started at http://127.7.113.254:46529/ using document root <none> and password file <none>
I20260806 04:50:07.027843 26650 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:07.027971 26650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:07.028332 26650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:07.031131 26650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "3bf72f866146438eb290010f2c45665a"
format_stamp: "Formatted at 2026-08-06 04:50:07 on dist-test-slave-0b58"
server_key: "3bbcb40f5e37ecce3f3c92099b7ff29c"
server_key_iv: "76163ae66a4b8c10c2550ee8ca8196ad"
server_key_version: "encryptionkey@0"
I20260806 04:50:07.031930 26650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "3bf72f866146438eb290010f2c45665a"
format_stamp: "Formatted at 2026-08-06 04:50:07 on dist-test-slave-0b58"
server_key: "3bbcb40f5e37ecce3f3c92099b7ff29c"
server_key_iv: "76163ae66a4b8c10c2550ee8ca8196ad"
server_key_version: "encryptionkey@0"
I20260806 04:50:07.037101 26650 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260806 04:50:07.040483 26664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:07.041677 26650 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:50:07.041867 26650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "3bf72f866146438eb290010f2c45665a"
format_stamp: "Formatted at 2026-08-06 04:50:07 on dist-test-slave-0b58"
server_key: "3bbcb40f5e37ecce3f3c92099b7ff29c"
server_key_iv: "76163ae66a4b8c10c2550ee8ca8196ad"
server_key_version: "encryptionkey@0"
I20260806 04:50:07.042073 26650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:07.053077 26650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:07.053833 26650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:07.054111 26650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:07.072407 26650 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:39849
I20260806 04:50:07.072451 26718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:39849 every 8 connection(s)
I20260806 04:50:07.073653 26650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:07.076611 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 26650
I20260806 04:50:07.076797 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:07.077374 7623 external_mini_cluster.cc:1428] Setting key 11969e25741dc6e41516b823b155d8b6
I20260806 04:50:07.077481 26719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:07.089908 26719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a: Bootstrap starting.
I20260806 04:50:07.090749 26722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:07.079285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48142 (local address 127.7.113.254:39849)
0806 04:50:07.080229 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:07.080248 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:07.080358 (+ 110us) server_negotiation.cc:407] Connection header received
0806 04:50:07.082129 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:07.082148 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:07.082606 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:07.083017 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:07.083582 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:07.084990 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:07.086345 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:07.087017 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:07.087251 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:07.088533 (+ 1282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:07.088540 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:07.088552 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:07.089049 (+ 497us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:07.089127 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:07.089147 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:07.089279 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:07.089522 (+ 243us) server_negotiation.cc:299] Negotiation successful
0806 04:50:07.089797 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":339,"threads_started":1}
I20260806 04:50:07.093364 26719 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:07.094349 26719 log.cc:824] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:07.097004 26719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a: No bootstrap required, opened a new log
I20260806 04:50:07.104033 26719 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bf72f866146438eb290010f2c45665a" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39849 } }
I20260806 04:50:07.104434 26719 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:07.104538 26719 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf72f866146438eb290010f2c45665a, State: Initialized, Role: FOLLOWER
I20260806 04:50:07.105064 26719 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bf72f866146438eb290010f2c45665a" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39849 } }
I20260806 04:50:07.105325 26719 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:07.105505 26719 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:07.105710 26719 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:07.107779 26719 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bf72f866146438eb290010f2c45665a" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39849 } }
I20260806 04:50:07.108309 26719 leader_election.cc:302] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3bf72f866146438eb290010f2c45665a; no voters:
I20260806 04:50:07.108875 26719 leader_election.cc:288] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:07.108994 26724 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:07.109719 26724 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [term 1 LEADER]: Becoming Leader. State: Replica: 3bf72f866146438eb290010f2c45665a, State: Running, Role: LEADER
I20260806 04:50:07.110232 26724 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bf72f866146438eb290010f2c45665a" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39849 } }
I20260806 04:50:07.110863 26719 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:07.113168 26726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3bf72f866146438eb290010f2c45665a. Latest consensus state: current_term: 1 leader_uuid: "3bf72f866146438eb290010f2c45665a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bf72f866146438eb290010f2c45665a" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39849 } } }
I20260806 04:50:07.113631 26726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:07.114161 26725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3bf72f866146438eb290010f2c45665a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bf72f866146438eb290010f2c45665a" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 39849 } } }
I20260806 04:50:07.114477 26725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:07.115111 26733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:07.121578 26733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:07.130450 26733 catalog_manager.cc:1347] Generated new cluster ID: 53a45ed74619432c87a9c16ade999a26
I20260806 04:50:07.130546 26733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:07.146119 26733 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:07.147269 26733 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:07.156008 26733 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a: Generated new TSK 0
I20260806 04:50:07.156761 26733 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:07.164124 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39849
--builtin_ntp_servers=127.7.113.212:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 04:50:07.502245 26743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:07.502609 26743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:07.502763 26743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:07.510123 26743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:07.510219 26743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:07.510322 26743 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:50:07.519806 26743 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:07.521054 26743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:07.522715 26743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:07.535789 26748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:07.535756 26749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:07.536269 26751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:07.536630 26743 server_base.cc:1034] running on GCE node
I20260806 04:50:07.537281 26743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:07.538178 26743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:07.539433 26743 hybrid_clock.cc:648] HybridClock initialized: now 1785991807539361 us; error 53 us; skew 500 ppm
I20260806 04:50:07.539824 26743 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:50:07.542021 26743 webserver.cc:460] Webserver started at http://127.7.113.193:44269/ using document root <none> and password file <none>
I20260806 04:50:07.542649 26743 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:07.542732 26743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:07.542992 26743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:07.545847 26743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "b7aaadf93d9e470c99d4837286a79578"
format_stamp: "Formatted at 2026-08-06 04:50:07 on dist-test-slave-0b58"
server_key: "c42901a26875c3adde9b2a114eaa4a8b"
server_key_iv: "3f96f75be2327d5d4c87192d4151a47e"
server_key_version: "encryptionkey@0"
I20260806 04:50:07.546640 26743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "b7aaadf93d9e470c99d4837286a79578"
format_stamp: "Formatted at 2026-08-06 04:50:07 on dist-test-slave-0b58"
server_key: "c42901a26875c3adde9b2a114eaa4a8b"
server_key_iv: "3f96f75be2327d5d4c87192d4151a47e"
server_key_version: "encryptionkey@0"
I20260806 04:50:07.551295 26743 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260806 04:50:07.554513 26757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:07.555737 26743 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 04:50:07.555860 26743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "b7aaadf93d9e470c99d4837286a79578"
format_stamp: "Formatted at 2026-08-06 04:50:07 on dist-test-slave-0b58"
server_key: "c42901a26875c3adde9b2a114eaa4a8b"
server_key_iv: "3f96f75be2327d5d4c87192d4151a47e"
server_key_version: "encryptionkey@0"
I20260806 04:50:07.556028 26743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:07.569425 26743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:07.570091 26743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:07.570446 26743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:07.571360 26743 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:07.572813 26743 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:07.572924 26743 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:07.573058 26743 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:07.573158 26743 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:07.605701 26743 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:44999
I20260806 04:50:07.605908 26870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:44999 every 8 connection(s)
I20260806 04:50:07.606984 26743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:50:07.608682 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 26743
I20260806 04:50:07.608865 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:50:07.609380 7623 external_mini_cluster.cc:1428] Setting key ee032b88425fe987f4b1003b648060a1
I20260806 04:50:07.612251 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39849
--builtin_ntp_servers=127.7.113.212:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 04:50:07.621212 26873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:07.609777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:34791 (local address 127.7.113.254:39849)
0806 04:50:07.610290 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:07.610294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:07.611883 (+ 1589us) server_negotiation.cc:407] Connection header received
0806 04:50:07.613961 (+ 2078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:07.613966 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:07.614048 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:07.614172 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:07.615521 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:07.616560 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:07.618481 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:07.618898 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:07.619031 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:07.620375 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:07.620380 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:07.620383 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:07.620400 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:07.620446 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:07.620458 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:07.620557 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:07.620775 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 04:50:07.620881 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":256,"threads_started":1}
I20260806 04:50:07.622284 26874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:07.610437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:39849 (local address 127.7.113.193:34791)
0806 04:50:07.611728 (+ 1291us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:07.611766 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:07.613695 (+ 1929us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:07.614424 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:07.614432 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:07.614531 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:07.615297 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:07.615325 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:07.616731 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:07.616746 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:07.618315 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:07.618328 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:07.619121 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:07.619128 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:07.619348 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:07.620054 (+ 706us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:50:07.620057 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:07.620092 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:50:07.620160 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:07.620558 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:07.620572 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:07.620582 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 04:50:07.620760 (+ 178us) client_negotiation.cc:240] Negotiation successful
0806 04:50:07.621118 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"thread_start_us":421,"threads_started":1}
I20260806 04:50:07.623718 26871 heartbeater.cc:347] Connected to a master server at 127.7.113.254:39849
I20260806 04:50:07.624022 26871 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:07.624807 26871 heartbeater.cc:511] Master 127.7.113.254:39849 requested a full tablet report, sending...
I20260806 04:50:07.626780 26682 ts_manager.cc:194] Registered new tserver with Master: b7aaadf93d9e470c99d4837286a79578 (127.7.113.193:44999)
I20260806 04:50:07.628471 26682 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.113.193:34791
W20260806 04:50:07.944700 26875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:07.945015 26875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:07.945182 26875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:07.952601 26875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:07.952741 26875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:07.952916 26875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:50:07.961707 26875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:07.962916 26875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:07.964684 26875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:07.977957 26883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:07.977999 26880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:07.977897 26881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:07.978824 26875 server_base.cc:1034] running on GCE node
I20260806 04:50:07.979389 26875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:07.980301 26875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:07.981536 26875 hybrid_clock.cc:648] HybridClock initialized: now 1785991807981494 us; error 30 us; skew 500 ppm
I20260806 04:50:07.981846 26875 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:50:07.983994 26875 webserver.cc:460] Webserver started at http://127.7.113.194:40213/ using document root <none> and password file <none>
I20260806 04:50:07.984726 26875 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:07.984861 26875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:07.985190 26875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:07.987872 26875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "f5019c4ae85141af897919feb4503f19"
format_stamp: "Formatted at 2026-08-06 04:50:07 on dist-test-slave-0b58"
server_key: "9bb305f52eb18dbda8628c20d6584c44"
server_key_iv: "1e71c0522c1304f644c12808a554db38"
server_key_version: "encryptionkey@0"
I20260806 04:50:07.988708 26875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "f5019c4ae85141af897919feb4503f19"
format_stamp: "Formatted at 2026-08-06 04:50:07 on dist-test-slave-0b58"
server_key: "9bb305f52eb18dbda8628c20d6584c44"
server_key_iv: "1e71c0522c1304f644c12808a554db38"
server_key_version: "encryptionkey@0"
I20260806 04:50:07.993569 26875 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260806 04:50:07.996953 26889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:07.998106 26875 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:50:07.998278 26875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "f5019c4ae85141af897919feb4503f19"
format_stamp: "Formatted at 2026-08-06 04:50:07 on dist-test-slave-0b58"
server_key: "9bb305f52eb18dbda8628c20d6584c44"
server_key_iv: "1e71c0522c1304f644c12808a554db38"
server_key_version: "encryptionkey@0"
I20260806 04:50:07.998494 26875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:08.010100 26875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:08.010831 26875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:08.011119 26875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:08.012014 26875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:08.013604 26875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:08.013829 26875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:08.013998 26875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:08.014127 26875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:08.047107 26875 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:35937
I20260806 04:50:08.047195 27003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:35937 every 8 connection(s)
I20260806 04:50:08.048417 26875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:50:08.054662 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 26875
I20260806 04:50:08.054885 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:50:08.055392 7623 external_mini_cluster.cc:1428] Setting key b1992fdf049ba7978248a60afc72666e
I20260806 04:50:08.058478 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39849
--builtin_ntp_servers=127.7.113.212:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 04:50:08.061724 26873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.050921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:40433 (local address 127.7.113.254:39849)
0806 04:50:08.051102 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:08.051106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:08.052580 (+ 1474us) server_negotiation.cc:407] Connection header received
0806 04:50:08.054328 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:08.054337 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:08.054448 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:08.054576 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:08.055691 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.056671 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.058485 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.059185 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.059341 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.060812 (+ 1471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:08.060820 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:08.060827 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:08.060852 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:08.060895 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:08.060913 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:08.061009 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:08.061252 (+ 243us) server_negotiation.cc:299] Negotiation successful
0806 04:50:08.061356 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 04:50:08.062544 27006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.051491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:39849 (local address 127.7.113.194:40433)
0806 04:50:08.052428 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:08.052469 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:08.054023 (+ 1554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:08.054731 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:08.054738 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:08.054872 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:08.055511 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:08.055534 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.056821 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.056826 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:08.058332 (+ 1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:08.058344 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.059401 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.059407 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:08.059663 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.060476 (+ 813us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:50:08.060479 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:08.060520 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:50:08.060590 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:08.061012 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:08.061019 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:08.061037 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 04:50:08.061196 (+ 159us) client_negotiation.cc:240] Negotiation successful
0806 04:50:08.061472 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":265,"threads_started":1}
I20260806 04:50:08.063930 27004 heartbeater.cc:347] Connected to a master server at 127.7.113.254:39849
I20260806 04:50:08.064240 27004 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:08.065133 27004 heartbeater.cc:511] Master 127.7.113.254:39849 requested a full tablet report, sending...
I20260806 04:50:08.066599 26682 ts_manager.cc:194] Registered new tserver with Master: f5019c4ae85141af897919feb4503f19 (127.7.113.194:35937)
I20260806 04:50:08.067386 26682 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.113.194:40433
W20260806 04:50:08.392511 27007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:08.392762 27007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:08.392906 27007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:08.399920 27007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:08.400002 27007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:08.400216 27007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:50:08.409037 27007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:39849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:08.410193 27007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:08.412041 27007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:08.424638 27012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:08.424719 27015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:08.424686 27013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:08.425498 27007 server_base.cc:1034] running on GCE node
I20260806 04:50:08.426062 27007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:08.426935 27007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:08.428128 27007 hybrid_clock.cc:648] HybridClock initialized: now 1785991808428095 us; error 26 us; skew 500 ppm
I20260806 04:50:08.428468 27007 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:50:08.430502 27007 webserver.cc:460] Webserver started at http://127.7.113.195:41551/ using document root <none> and password file <none>
I20260806 04:50:08.431259 27007 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:08.431370 27007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:08.431684 27007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:08.434381 27007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "b32dc49eded0413d84b101980ec40d61"
format_stamp: "Formatted at 2026-08-06 04:50:08 on dist-test-slave-0b58"
server_key: "079eece428ee6352b95626cfe7672ca6"
server_key_iv: "f5df4fb230442b1b1f37df0b1f6a5c7b"
server_key_version: "encryptionkey@0"
I20260806 04:50:08.435220 27007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "b32dc49eded0413d84b101980ec40d61"
format_stamp: "Formatted at 2026-08-06 04:50:08 on dist-test-slave-0b58"
server_key: "079eece428ee6352b95626cfe7672ca6"
server_key_iv: "f5df4fb230442b1b1f37df0b1f6a5c7b"
server_key_version: "encryptionkey@0"
I20260806 04:50:08.440387 27007 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260806 04:50:08.443543 27021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:08.444808 27007 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:50:08.444990 27007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "b32dc49eded0413d84b101980ec40d61"
format_stamp: "Formatted at 2026-08-06 04:50:08 on dist-test-slave-0b58"
server_key: "079eece428ee6352b95626cfe7672ca6"
server_key_iv: "f5df4fb230442b1b1f37df0b1f6a5c7b"
server_key_version: "encryptionkey@0"
I20260806 04:50:08.445209 27007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:08.481653 27007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:08.482460 27007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:08.482769 27007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:08.483718 27007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:08.485252 27007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:08.485374 27007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:08.485502 27007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:08.485589 27007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:08.518743 27007 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:42183
I20260806 04:50:08.518790 27135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:42183 every 8 connection(s)
I20260806 04:50:08.519968 27007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:50:08.529606 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 27007
I20260806 04:50:08.529798 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:50:08.530293 7623 external_mini_cluster.cc:1428] Setting key 2db4c6ce02c44978937c0ce5cd4d068c
I20260806 04:50:08.532055 26873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.522480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:45007 (local address 127.7.113.254:39849)
0806 04:50:08.522694 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:08.522700 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:08.524084 (+ 1384us) server_negotiation.cc:407] Connection header received
0806 04:50:08.525824 (+ 1740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:08.525828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:08.525896 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:08.525985 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:08.527014 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.527741 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.529284 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.529723 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.529862 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.531232 (+ 1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:08.531244 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:08.531248 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:08.531265 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:08.531297 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:08.531308 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:08.531423 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:08.531683 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 04:50:08.531759 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 04:50:08.533249 27138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.523072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:39849 (local address 127.7.113.195:45007)
0806 04:50:08.523941 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:08.523977 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:08.525597 (+ 1620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:08.526221 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:08.526230 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:08.526333 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:08.526863 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:08.526880 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.527873 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.527877 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:08.529155 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:08.529167 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.529965 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.529972 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:08.530206 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.530908 (+ 702us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:50:08.530910 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:08.530953 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:50:08.531025 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:08.531440 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:08.531451 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:08.531458 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 04:50:08.531667 (+ 209us) client_negotiation.cc:240] Negotiation successful
0806 04:50:08.532012 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":280,"threads_started":1}
I20260806 04:50:08.534416 27136 heartbeater.cc:347] Connected to a master server at 127.7.113.254:39849
I20260806 04:50:08.534700 27136 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:08.535368 27136 heartbeater.cc:511] Master 127.7.113.254:39849 requested a full tablet report, sending...
I20260806 04:50:08.536671 26682 ts_manager.cc:194] Registered new tserver with Master: b32dc49eded0413d84b101980ec40d61 (127.7.113.195:42183)
I20260806 04:50:08.537446 26682 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.113.195:45007
I20260806 04:50:08.545509 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:50:08.555445 26873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.549703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48150 (local address 127.7.113.254:39849)
0806 04:50:08.549935 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:08.549944 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:08.550428 (+ 484us) server_negotiation.cc:407] Connection header received
0806 04:50:08.550547 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:08.550550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:08.550616 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:08.550693 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:08.551108 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.551767 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.553291 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.553659 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.553750 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.554714 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:08.554719 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:08.554722 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:08.554737 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:08.554766 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:08.554777 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:08.554885 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:08.555037 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 04:50:08.555116 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 04:50:08.558944 26682 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48150:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:50:08.565697 26682 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:50:08.587934 27149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.577040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:44999 (local address 127.0.0.1:44206)
0806 04:50:08.577941 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:08.577983 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:08.578146 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:08.580155 (+ 2009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:08.580166 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:08.580204 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:08.580669 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:08.580681 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.582410 (+ 1729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.582417 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:08.585083 (+ 2666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:08.585098 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.586933 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.586940 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:08.587129 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.587189 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 04:50:08.587305 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 04:50:08.587486 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"mutex_wait_us":70,"thread_start_us":2392,"threads_started":1}
I20260806 04:50:08.588081 27152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.577195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:42183 (local address 127.0.0.1:34802)
0806 04:50:08.579662 (+ 2467us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:08.579679 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:08.579873 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:08.580829 (+ 956us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:08.580833 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:08.580860 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:08.581229 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:08.581257 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.583187 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.583192 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:08.585029 (+ 1837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:08.585042 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.587278 (+ 2236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.587286 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:08.587445 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.587478 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 04:50:08.587615 (+ 137us) client_negotiation.cc:240] Negotiation successful
0806 04:50:08.587735 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2330,"mutex_wait_us":1,"thread_start_us":374,"threads_started":1}
I20260806 04:50:08.588677 27150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.577281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44206 (local address 127.7.113.193:44999)
0806 04:50:08.578702 (+ 1421us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:08.578712 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:08.578743 (+ 31us) server_negotiation.cc:407] Connection header received
0806 04:50:08.578864 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:08.578876 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:08.579120 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:08.580871 (+ 1751us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:08.581038 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.582278 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.585302 (+ 3024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.586710 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.587794 (+ 1084us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.588019 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:08.588096 (+ 77us) server_negotiation.cc:299] Negotiation successful
0806 04:50:08.588302 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1238,"thread_start_us":1130,"threads_started":1}
I20260806 04:50:08.588680 27153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.579253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48806 (local address 127.7.113.194:35937)
0806 04:50:08.580804 (+ 1551us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:08.580812 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:08.580836 (+ 24us) server_negotiation.cc:407] Connection header received
0806 04:50:08.580936 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:08.580945 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:08.581155 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:08.581353 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:08.581879 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.583588 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.585914 (+ 2326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.587272 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.587444 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.587678 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:08.588166 (+ 488us) server_negotiation.cc:299] Negotiation successful
0806 04:50:08.588345 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1388,"thread_start_us":1268,"threads_started":1}
I20260806 04:50:08.588819 27151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.577701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34802 (local address 127.7.113.195:42183)
0806 04:50:08.579116 (+ 1415us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:08.579128 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:08.579771 (+ 643us) server_negotiation.cc:407] Connection header received
0806 04:50:08.580059 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:08.580067 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:08.580338 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:08.580517 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:08.581438 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.582994 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.585215 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.586710 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.586856 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.587136 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:08.588199 (+ 1063us) server_negotiation.cc:299] Negotiation successful
0806 04:50:08.588396 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1223,"thread_start_us":1054,"threads_started":1}
I20260806 04:50:08.589361 27148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.578783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:35937 (local address 127.0.0.1:48806)
0806 04:50:08.579771 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:08.579792 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:08.579938 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:08.581369 (+ 1431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:08.581374 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:08.581400 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:08.581694 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:08.581705 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.583746 (+ 2041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.583752 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:08.585732 (+ 1980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:08.585743 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.587487 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.587493 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:08.587722 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.587759 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 04:50:08.587843 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 04:50:08.587985 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":823,"mutex_wait_us":24,"thread_start_us":671,"threads_started":1}
I20260806 04:50:08.592679 26937 tablet_service.cc:1467] Processing CreateTablet for tablet f76282c56b4b40ad90e38ea9754cd24f (DEFAULT_TABLE table=test-table [id=9ff2d6c3ff724c7ab6c8f54d676c9e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:08.592701 26806 tablet_service.cc:1467] Processing CreateTablet for tablet f76282c56b4b40ad90e38ea9754cd24f (DEFAULT_TABLE table=test-table [id=9ff2d6c3ff724c7ab6c8f54d676c9e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:08.592701 27070 tablet_service.cc:1467] Processing CreateTablet for tablet f76282c56b4b40ad90e38ea9754cd24f (DEFAULT_TABLE table=test-table [id=9ff2d6c3ff724c7ab6c8f54d676c9e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:08.593909 26937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f76282c56b4b40ad90e38ea9754cd24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:08.594024 26806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f76282c56b4b40ad90e38ea9754cd24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:08.594017 27070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f76282c56b4b40ad90e38ea9754cd24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:08.605351 27154 tablet_bootstrap.cc:492] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19: Bootstrap starting.
I20260806 04:50:08.610049 27154 tablet_bootstrap.cc:654] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:08.611478 27154 log.cc:824] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:08.614368 27155 tablet_bootstrap.cc:492] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578: Bootstrap starting.
I20260806 04:50:08.615577 27156 tablet_bootstrap.cc:492] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61: Bootstrap starting.
I20260806 04:50:08.620508 27155 tablet_bootstrap.cc:654] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:08.621991 27155 log.cc:824] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:08.622984 27156 tablet_bootstrap.cc:654] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:08.623701 27154 tablet_bootstrap.cc:492] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19: No bootstrap required, opened a new log
I20260806 04:50:08.623971 27154 ts_tablet_manager.cc:1397] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.009s
I20260806 04:50:08.624125 27156 log.cc:824] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:08.625066 27155 tablet_bootstrap.cc:492] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578: No bootstrap required, opened a new log
I20260806 04:50:08.625315 27155 ts_tablet_manager.cc:1397] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.001s
I20260806 04:50:08.627058 27156 tablet_bootstrap.cc:492] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61: No bootstrap required, opened a new log
I20260806 04:50:08.627295 27156 ts_tablet_manager.cc:1397] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260806 04:50:08.631103 26871 heartbeater.cc:503] Master 127.7.113.254:39849 was elected leader, sending a full tablet report...
I20260806 04:50:08.632097 27154 raft_consensus.cc:348] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7aaadf93d9e470c99d4837286a79578" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 44999 } } peers { permanent_uuid: "b32dc49eded0413d84b101980ec40d61" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 42183 } } peers { permanent_uuid: "f5019c4ae85141af897919feb4503f19" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35937 } }
I20260806 04:50:08.632575 27154 raft_consensus.cc:374] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:08.632701 27154 raft_consensus.cc:729] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5019c4ae85141af897919feb4503f19, State: Initialized, Role: FOLLOWER
I20260806 04:50:08.633450 27154 consensus_queue.cc:260] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7aaadf93d9e470c99d4837286a79578" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 44999 } } peers { permanent_uuid: "b32dc49eded0413d84b101980ec40d61" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 42183 } } peers { permanent_uuid: "f5019c4ae85141af897919feb4503f19" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35937 } }
I20260806 04:50:08.636520 27155 raft_consensus.cc:348] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7aaadf93d9e470c99d4837286a79578" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 44999 } } peers { permanent_uuid: "b32dc49eded0413d84b101980ec40d61" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 42183 } } peers { permanent_uuid: "f5019c4ae85141af897919feb4503f19" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35937 } }
I20260806 04:50:08.636917 27155 raft_consensus.cc:374] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:08.636965 27004 heartbeater.cc:503] Master 127.7.113.254:39849 was elected leader, sending a full tablet report...
I20260806 04:50:08.637010 27155 raft_consensus.cc:729] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7aaadf93d9e470c99d4837286a79578, State: Initialized, Role: FOLLOWER
I20260806 04:50:08.637574 27155 consensus_queue.cc:260] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7aaadf93d9e470c99d4837286a79578" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 44999 } } peers { permanent_uuid: "b32dc49eded0413d84b101980ec40d61" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 42183 } } peers { permanent_uuid: "f5019c4ae85141af897919feb4503f19" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35937 } }
I20260806 04:50:08.637594 27156 raft_consensus.cc:348] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7aaadf93d9e470c99d4837286a79578" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 44999 } } peers { permanent_uuid: "b32dc49eded0413d84b101980ec40d61" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 42183 } } peers { permanent_uuid: "f5019c4ae85141af897919feb4503f19" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35937 } }
I20260806 04:50:08.638087 27156 raft_consensus.cc:374] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:08.638255 27156 raft_consensus.cc:729] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b32dc49eded0413d84b101980ec40d61, State: Initialized, Role: FOLLOWER
I20260806 04:50:08.638872 27154 ts_tablet_manager.cc:1428] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19: Time spent starting tablet: real 0.015s user 0.006s sys 0.009s
I20260806 04:50:08.639086 27156 consensus_queue.cc:260] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7aaadf93d9e470c99d4837286a79578" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 44999 } } peers { permanent_uuid: "b32dc49eded0413d84b101980ec40d61" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 42183 } } peers { permanent_uuid: "f5019c4ae85141af897919feb4503f19" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35937 } }
I20260806 04:50:08.640372 27136 heartbeater.cc:503] Master 127.7.113.254:39849 was elected leader, sending a full tablet report...
I20260806 04:50:08.640453 27155 ts_tablet_manager.cc:1428] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578: Time spent starting tablet: real 0.015s user 0.007s sys 0.009s
I20260806 04:50:08.640815 27156 ts_tablet_manager.cc:1428] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61: Time spent starting tablet: real 0.013s user 0.015s sys 0.000s
W20260806 04:50:08.771728 27137 tablet.cc:2369] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:50:08.800559 27005 tablet.cc:2369] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:50:08.859472 26872 tablet.cc:2369] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:50:08.862454 27160 raft_consensus.cc:482] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:50:08.862703 27160 raft_consensus.cc:504] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7aaadf93d9e470c99d4837286a79578" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 44999 } } peers { permanent_uuid: "b32dc49eded0413d84b101980ec40d61" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 42183 } } peers { permanent_uuid: "f5019c4ae85141af897919feb4503f19" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35937 } }
I20260806 04:50:08.864363 27160 leader_election.cc:288] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7aaadf93d9e470c99d4837286a79578 (127.7.113.193:44999), b32dc49eded0413d84b101980ec40d61 (127.7.113.195:42183)
I20260806 04:50:08.871224 27150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.864841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:57763 (local address 127.7.113.193:44999)
0806 04:50:08.865041 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:08.865046 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:08.865706 (+ 660us) server_negotiation.cc:407] Connection header received
0806 04:50:08.865848 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:08.865851 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:08.865969 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:08.866068 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:08.866763 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.867442 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.869536 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.870302 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.870482 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.870557 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:08.870843 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 04:50:08.870966 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 04:50:08.871310 27164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.864767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:44999 (local address 127.7.113.194:57763)
0806 04:50:08.865585 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:08.865600 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:08.865736 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:08.866094 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:08.866097 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:08.866128 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:08.866607 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:08.866621 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.867567 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.867573 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:08.869331 (+ 1758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:08.869343 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.870493 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.870500 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:08.870665 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.870704 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 04:50:08.870811 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 04:50:08.870927 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"mutex_wait_us":142,"thread_start_us":505,"threads_started":1}
I20260806 04:50:08.871330 27151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.864770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:46645 (local address 127.7.113.195:42183)
0806 04:50:08.864967 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:08.864974 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:08.865533 (+ 559us) server_negotiation.cc:407] Connection header received
0806 04:50:08.865714 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:08.865719 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:08.865812 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:08.865891 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:08.866656 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.867442 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.869579 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.870317 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.870503 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.870571 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:08.870936 (+ 365us) server_negotiation.cc:299] Negotiation successful
0806 04:50:08.871087 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 04:50:08.872025 27163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.864586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:42183 (local address 127.7.113.194:46645)
0806 04:50:08.865403 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:08.865425 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:08.865571 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:08.865931 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:08.865936 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:08.865976 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:08.866495 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:08.866510 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.867564 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.867569 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:08.869342 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:08.869354 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.870521 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.870527 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:08.870706 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.870769 (+ 63us) client_negotiation.cc:769] Sending connection context
0806 04:50:08.871552 (+ 783us) client_negotiation.cc:240] Negotiation successful
0806 04:50:08.871692 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"mutex_wait_us":156,"thread_start_us":416,"threads_started":1}
I20260806 04:50:08.872617 26826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f76282c56b4b40ad90e38ea9754cd24f" candidate_uuid: "f5019c4ae85141af897919feb4503f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aaadf93d9e470c99d4837286a79578" is_pre_election: true
I20260806 04:50:08.873071 27091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f76282c56b4b40ad90e38ea9754cd24f" candidate_uuid: "f5019c4ae85141af897919feb4503f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b32dc49eded0413d84b101980ec40d61" is_pre_election: true
I20260806 04:50:08.873276 26826 raft_consensus.cc:2454] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5019c4ae85141af897919feb4503f19 in term 0.
I20260806 04:50:08.873603 27091 raft_consensus.cc:2454] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5019c4ae85141af897919feb4503f19 in term 0.
I20260806 04:50:08.874048 26892 leader_election.cc:302] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7aaadf93d9e470c99d4837286a79578, f5019c4ae85141af897919feb4503f19; no voters:
I20260806 04:50:08.874526 27160 raft_consensus.cc:2781] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:50:08.874670 27160 raft_consensus.cc:482] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:50:08.874796 27160 raft_consensus.cc:3037] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:08.877063 27160 raft_consensus.cc:504] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7aaadf93d9e470c99d4837286a79578" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 44999 } } peers { permanent_uuid: "b32dc49eded0413d84b101980ec40d61" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 42183 } } peers { permanent_uuid: "f5019c4ae85141af897919feb4503f19" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35937 } }
I20260806 04:50:08.877678 27160 leader_election.cc:288] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [CANDIDATE]: Term 1 election: Requested vote from peers b7aaadf93d9e470c99d4837286a79578 (127.7.113.193:44999), b32dc49eded0413d84b101980ec40d61 (127.7.113.195:42183)
I20260806 04:50:08.878085 26826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f76282c56b4b40ad90e38ea9754cd24f" candidate_uuid: "f5019c4ae85141af897919feb4503f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aaadf93d9e470c99d4837286a79578"
I20260806 04:50:08.878157 27091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f76282c56b4b40ad90e38ea9754cd24f" candidate_uuid: "f5019c4ae85141af897919feb4503f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b32dc49eded0413d84b101980ec40d61"
I20260806 04:50:08.878305 26826 raft_consensus.cc:3037] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:08.878345 27091 raft_consensus.cc:3037] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:08.881611 27091 raft_consensus.cc:2454] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5019c4ae85141af897919feb4503f19 in term 1.
I20260806 04:50:08.881611 26826 raft_consensus.cc:2454] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5019c4ae85141af897919feb4503f19 in term 1.
I20260806 04:50:08.882088 26893 leader_election.cc:302] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b32dc49eded0413d84b101980ec40d61, f5019c4ae85141af897919feb4503f19; no voters:
I20260806 04:50:08.882414 27160 raft_consensus.cc:2781] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:08.882858 27160 raft_consensus.cc:686] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [term 1 LEADER]: Becoming Leader. State: Replica: f5019c4ae85141af897919feb4503f19, State: Running, Role: LEADER
I20260806 04:50:08.883402 27160 consensus_queue.cc:237] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7aaadf93d9e470c99d4837286a79578" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 44999 } } peers { permanent_uuid: "b32dc49eded0413d84b101980ec40d61" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 42183 } } peers { permanent_uuid: "f5019c4ae85141af897919feb4503f19" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35937 } }
I20260806 04:50:08.887828 26681 catalog_manager.cc:5495] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5019c4ae85141af897919feb4503f19 (127.7.113.194). New cstate: current_term: 1 leader_uuid: "f5019c4ae85141af897919feb4503f19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7aaadf93d9e470c99d4837286a79578" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 44999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b32dc49eded0413d84b101980ec40d61" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5019c4ae85141af897919feb4503f19" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35937 } health_report { overall_health: HEALTHY } } }
I20260806 04:50:08.958446 27153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:08.951777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48820 (local address 127.7.113.194:35937)
0806 04:50:08.951965 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:08.951970 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:08.951991 (+ 21us) server_negotiation.cc:407] Connection header received
0806 04:50:08.952157 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:08.952163 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:08.952309 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:08.952478 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:50:08.952878 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.953939 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.955831 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:08.956247 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:08.956432 (+ 185us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:08.957030 (+ 598us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:50:08.957564 (+ 534us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:50:08.957798 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:08.958035 (+ 237us) server_negotiation.cc:299] Negotiation successful
0806 04:50:08.958081 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 04:50:08.969717 27091 raft_consensus.cc:1261] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61 [term 1 FOLLOWER]: Refusing update from remote peer f5019c4ae85141af897919feb4503f19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:50:08.969756 26826 raft_consensus.cc:1261] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578 [term 1 FOLLOWER]: Refusing update from remote peer f5019c4ae85141af897919feb4503f19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:50:08.970788 27160 consensus_queue.cc:1035] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aaadf93d9e470c99d4837286a79578" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 44999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:50:08.971487 27160 consensus_queue.cc:1035] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b32dc49eded0413d84b101980ec40d61" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:50:08.982829 27168 mvcc.cc:205] Tried to move back new op lower bound from 7315422449527558144 to 7315422449190539264. Current Snapshot: MvccSnapshot[applied={T|T < 7315422449527558144}]
I20260806 04:50:09.004136 26682 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48150:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:50:09.004501 26682 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48150:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:50:09.007822 26682 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3bf72f866146438eb290010f2c45665a: Sending DeleteTablet for 3 replicas of tablet f76282c56b4b40ad90e38ea9754cd24f
I20260806 04:50:09.008975 26806 tablet_service.cc:1514] Processing DeleteTablet for tablet f76282c56b4b40ad90e38ea9754cd24f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:09 UTC) from {username='slave'} at 127.0.0.1:44206
I20260806 04:50:09.009140 27070 tablet_service.cc:1514] Processing DeleteTablet for tablet f76282c56b4b40ad90e38ea9754cd24f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:09 UTC) from {username='slave'} at 127.0.0.1:34802
I20260806 04:50:09.010013 26937 tablet_service.cc:1514] Processing DeleteTablet for tablet f76282c56b4b40ad90e38ea9754cd24f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:09 UTC) from {username='slave'} at 127.0.0.1:48806
I20260806 04:50:09.010687 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 26743
I20260806 04:50:09.014686 27180 tablet_replica.cc:330] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19: stopping tablet replica
I20260806 04:50:09.015260 27180 raft_consensus.cc:2229] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:50:09.016398 27180 raft_consensus.cc:2258] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:09.017385 27178 tablet_replica.cc:330] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578: stopping tablet replica
I20260806 04:50:09.018036 27178 raft_consensus.cc:2229] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:50:09.018841 27180 ts_tablet_manager.cc:1905] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:09.019192 27178 raft_consensus.cc:2258] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:09.022274 27178 ts_tablet_manager.cc:1905] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:09.029850 27178 ts_tablet_manager.cc:1918] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:50:09.030102 27178 log.cc:1196] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/f76282c56b4b40ad90e38ea9754cd24f
I20260806 04:50:09.030711 27178 ts_tablet_manager.cc:1939] T f76282c56b4b40ad90e38ea9754cd24f P b7aaadf93d9e470c99d4837286a79578: Deleting consensus metadata
I20260806 04:50:09.033077 26667 catalog_manager.cc:4841] TS b7aaadf93d9e470c99d4837286a79578 (127.7.113.193:44999): tablet f76282c56b4b40ad90e38ea9754cd24f (table test-table [id=9ff2d6c3ff724c7ab6c8f54d676c9e84]) successfully deleted
I20260806 04:50:09.033593 27150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:09.011797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44220 (local address 127.7.113.193:44999)
0806 04:50:09.012989 (+ 1192us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:09.012998 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:09.025022 (+ 12024us) server_negotiation.cc:407] Connection header received
0806 04:50:09.025502 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:09.025521 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:09.025613 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:09.025678 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:09.026329 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:09.027540 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:09.029561 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:09.030231 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:09.030364 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:09.031866 (+ 1502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:09.031878 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:09.031894 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:09.032694 (+ 800us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:09.032753 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:09.032774 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:09.032850 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:09.033105 (+ 255us) server_negotiation.cc:299] Negotiation successful
0806 04:50:09.033215 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1019}
I20260806 04:50:09.034150 27180 ts_tablet_manager.cc:1918] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:50:09.034329 27180 log.cc:1196] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/f76282c56b4b40ad90e38ea9754cd24f
I20260806 04:50:09.034669 26866 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:09.034926 27180 ts_tablet_manager.cc:1939] T f76282c56b4b40ad90e38ea9754cd24f P f5019c4ae85141af897919feb4503f19: Deleting consensus metadata
I20260806 04:50:09.036482 27179 tablet_replica.cc:330] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61: stopping tablet replica
I20260806 04:50:09.037107 27179 raft_consensus.cc:2229] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:50:09.037626 27179 raft_consensus.cc:2258] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:09.039160 26668 catalog_manager.cc:4841] TS f5019c4ae85141af897919feb4503f19 (127.7.113.194:35937): tablet f76282c56b4b40ad90e38ea9754cd24f (table test-table [id=9ff2d6c3ff724c7ab6c8f54d676c9e84]) successfully deleted
I20260806 04:50:09.040619 27179 ts_tablet_manager.cc:1905] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:09.047856 27179 ts_tablet_manager.cc:1918] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:50:09.048048 27179 log.cc:1196] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/f76282c56b4b40ad90e38ea9754cd24f
I20260806 04:50:09.048623 27179 ts_tablet_manager.cc:1939] T f76282c56b4b40ad90e38ea9754cd24f P b32dc49eded0413d84b101980ec40d61: Deleting consensus metadata
I20260806 04:50:09.050343 26668 catalog_manager.cc:4841] TS b32dc49eded0413d84b101980ec40d61 (127.7.113.195:42183): tablet f76282c56b4b40ad90e38ea9754cd24f (table test-table [id=9ff2d6c3ff724c7ab6c8f54d676c9e84]) successfully deleted
I20260806 04:50:09.171113 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 26743
I20260806 04:50:09.190265 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 26875
I20260806 04:50:09.197741 27153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:09.191060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48830 (local address 127.7.113.194:35937)
0806 04:50:09.191271 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:09.191278 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:09.191382 (+ 104us) server_negotiation.cc:407] Connection header received
0806 04:50:09.191580 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:09.191586 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:09.191673 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:09.191801 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:09.192202 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:09.193068 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:09.194402 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:09.194847 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:09.194989 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:09.196122 (+ 1133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:09.196137 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:09.196150 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:09.196934 (+ 784us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:09.196984 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:09.197005 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:09.197139 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:09.197294 (+ 155us) server_negotiation.cc:299] Negotiation successful
0806 04:50:09.197389 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 04:50:09.198443 26999 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:09.308164 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 26875
I20260806 04:50:09.328756 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 27007
I20260806 04:50:09.335630 27151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:09.329536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34808 (local address 127.7.113.195:42183)
0806 04:50:09.329713 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:09.329720 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:09.329770 (+ 50us) server_negotiation.cc:407] Connection header received
0806 04:50:09.329990 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:09.329994 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:09.330074 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:09.330179 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:09.330606 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:09.331314 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:09.332667 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:09.333078 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:09.333209 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:09.334321 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:09.334331 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:09.334345 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:09.334893 (+ 548us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:09.334938 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:09.334958 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:09.335079 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:09.335210 (+ 131us) server_negotiation.cc:299] Negotiation successful
0806 04:50:09.335316 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 04:50:09.336309 27131 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:09.424110 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 27007
I20260806 04:50:09.442435 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 26650
I20260806 04:50:09.443536 26714 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:09.551637 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 26650
2026-08-06T04:50:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2974 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:09 dist-test-slave-0b58 krb5kdc[27188](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:09 dist-test-slave-0b58 krb5kdc[27188](info): set up 2 sockets
Aug 06 04:50:09 dist-test-slave-0b58 krb5kdc[27188](info): commencing operation
krb5kdc: starting...
W20260806 04:50:10.674649 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.005s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:10 dist-test-slave-0b58 krb5kdc[27188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:50:10.956662 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:41827
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:41801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:41827
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:11.290571 27202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:11.290819 27202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:11.290905 27202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:11.298398 27202 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:11.298497 27202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:11.298550 27202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:11.298605 27202 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:11.298647 27202 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:11.308117 27202 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:41801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:41827
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:41827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:11.309319 27202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:11.310539 27202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:11.322258 27210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:11.322309 27207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:11.323065 27208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:11.325709 27202 server_base.cc:1034] running on GCE node
I20260806 04:50:11.326501 27202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:11.327770 27202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:11.328994 27202 hybrid_clock.cc:648] HybridClock initialized: now 1785991811328942 us; error 35 us; skew 500 ppm
I20260806 04:50:11.329331 27202 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:11 dist-test-slave-0b58 krb5kdc[27188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991811, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:11.335122 27202 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:50:11.336645 27202 webserver.cc:460] Webserver started at http://127.7.113.254:36333/ using document root <none> and password file <none>
I20260806 04:50:11.337302 27202 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:11.337450 27202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:11.337756 27202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:11.340657 27202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "6dd433e97c9b46c0b25268ce80a6ef04"
format_stamp: "Formatted at 2026-08-06 04:50:11 on dist-test-slave-0b58"
server_key: "8f5bf3095b4fb60ba1d78c933c02f8ca"
server_key_iv: "a9da6d76c31ba3dbab3861d92e5a6241"
server_key_version: "encryptionkey@0"
I20260806 04:50:11.341450 27202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "6dd433e97c9b46c0b25268ce80a6ef04"
format_stamp: "Formatted at 2026-08-06 04:50:11 on dist-test-slave-0b58"
server_key: "8f5bf3095b4fb60ba1d78c933c02f8ca"
server_key_iv: "a9da6d76c31ba3dbab3861d92e5a6241"
server_key_version: "encryptionkey@0"
I20260806 04:50:11.346334 27202 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 04:50:11.349521 27217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:11.350718 27202 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 04:50:11.350898 27202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "6dd433e97c9b46c0b25268ce80a6ef04"
format_stamp: "Formatted at 2026-08-06 04:50:11 on dist-test-slave-0b58"
server_key: "8f5bf3095b4fb60ba1d78c933c02f8ca"
server_key_iv: "a9da6d76c31ba3dbab3861d92e5a6241"
server_key_version: "encryptionkey@0"
I20260806 04:50:11.351086 27202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:11.385468 27202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:11.389328 27202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:11.389617 27202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:11.407907 27202 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:41827
I20260806 04:50:11.407930 27269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:41827 every 8 connection(s)
I20260806 04:50:11.409333 27202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:11.412341 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 27202
I20260806 04:50:11.412539 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:11.413075 7623 external_mini_cluster.cc:1428] Setting key a571d92371659c218bfda6b91628d2e0
I20260806 04:50:11.413326 27270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:11.427987 27270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04: Bootstrap starting.
Aug 06 04:50:11 dist-test-slave-0b58 krb5kdc[27188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:50:11.431975 27270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:11.433107 27270 log.cc:824] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:11.436430 27270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04: No bootstrap required, opened a new log
I20260806 04:50:11.437323 27273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:11.414982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46742 (local address 127.7.113.254:41827)
0806 04:50:11.415825 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:11.415836 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:11.415874 (+ 38us) server_negotiation.cc:407] Connection header received
0806 04:50:11.418015 (+ 2141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:11.418035 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:11.418408 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:11.418727 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:11.420685 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:11.422007 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:11.423727 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:11.424524 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:11.424652 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:11.429587 (+ 4935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:11.429599 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:11.429615 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:11.429678 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:11.433140 (+ 3462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:11.434009 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:11.434021 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:11.434029 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:11.434241 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:11.434695 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:11.434698 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:11.434700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:11.435160 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:11.435393 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:11.435894 (+ 501us) server_negotiation.cc:299] Negotiation successful
0806 04:50:11.436242 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":410,"threads_started":1}
I20260806 04:50:11.445034 27270 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dd433e97c9b46c0b25268ce80a6ef04" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41827 } }
I20260806 04:50:11.445379 27270 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:11.445490 27270 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dd433e97c9b46c0b25268ce80a6ef04, State: Initialized, Role: FOLLOWER
I20260806 04:50:11.446105 27270 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dd433e97c9b46c0b25268ce80a6ef04" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41827 } }
I20260806 04:50:11.446431 27270 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:11.446588 27270 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:11.446769 27270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:11.448942 27270 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dd433e97c9b46c0b25268ce80a6ef04" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41827 } }
I20260806 04:50:11.449344 27270 leader_election.cc:302] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6dd433e97c9b46c0b25268ce80a6ef04; no voters:
I20260806 04:50:11.449882 27270 leader_election.cc:288] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:11.449987 27275 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:11.451787 27270 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:11.452178 27275 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [term 1 LEADER]: Becoming Leader. State: Replica: 6dd433e97c9b46c0b25268ce80a6ef04, State: Running, Role: LEADER
I20260806 04:50:11.452687 27275 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dd433e97c9b46c0b25268ce80a6ef04" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41827 } }
I20260806 04:50:11.455495 27276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6dd433e97c9b46c0b25268ce80a6ef04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dd433e97c9b46c0b25268ce80a6ef04" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41827 } } }
I20260806 04:50:11.455883 27276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:11.456005 27277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6dd433e97c9b46c0b25268ce80a6ef04. Latest consensus state: current_term: 1 leader_uuid: "6dd433e97c9b46c0b25268ce80a6ef04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dd433e97c9b46c0b25268ce80a6ef04" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 41827 } } }
I20260806 04:50:11.456323 27277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:11.457720 27285 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:11.462772 27285 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:11.471171 27285 catalog_manager.cc:1347] Generated new cluster ID: 60d25701ae2d4e40a106e09f78dc92d0
I20260806 04:50:11.471278 27285 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:11.491632 27285 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:11.492913 27285 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:11.499627 27285 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04: Generated new TSK 0
I20260806 04:50:11.500531 27285 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.113.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
Entry for principal kudu/127.7.113.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab.
I20260806 04:50:11.587579 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41827
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:41801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:11.931885 27296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:11.932123 27296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:11.932221 27296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:11.939344 27296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:11.939437 27296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:11.939540 27296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:50:11.948696 27296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:41801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.193.keytab
--principal=kudu/127.7.113.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41827
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:11.949802 27296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:11.950937 27296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:11.963840 27301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:11.963868 27304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:11.963937 27302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:11.964707 27296 server_base.cc:1034] running on GCE node
I20260806 04:50:11.965299 27296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:11.966118 27296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:11.967406 27296 hybrid_clock.cc:648] HybridClock initialized: now 1785991811967331 us; error 45 us; skew 500 ppm
I20260806 04:50:11.967692 27296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:11 dist-test-slave-0b58 krb5kdc[27188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991811, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:11.970865 27296 init.cc:377] Logged in from keytab as kudu/127.7.113.193@KRBTEST.COM (short username kudu)
I20260806 04:50:11.972177 27296 webserver.cc:460] Webserver started at http://127.7.113.193:40513/ using document root <none> and password file <none>
I20260806 04:50:11.972834 27296 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:11.972994 27296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:11.973343 27296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:11.976014 27296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "1b6f225409e748e9a3232131440d9309"
format_stamp: "Formatted at 2026-08-06 04:50:11 on dist-test-slave-0b58"
server_key: "dc39c152f29302dba0c584809dd5df0e"
server_key_iv: "521537f6bf0686d0cfec0f3018a2052a"
server_key_version: "encryptionkey@0"
I20260806 04:50:11.976824 27296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "1b6f225409e748e9a3232131440d9309"
format_stamp: "Formatted at 2026-08-06 04:50:11 on dist-test-slave-0b58"
server_key: "dc39c152f29302dba0c584809dd5df0e"
server_key_iv: "521537f6bf0686d0cfec0f3018a2052a"
server_key_version: "encryptionkey@0"
I20260806 04:50:11.981770 27296 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:50:11.984927 27311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:11.986085 27296 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 04:50:11.986310 27296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "1b6f225409e748e9a3232131440d9309"
format_stamp: "Formatted at 2026-08-06 04:50:11 on dist-test-slave-0b58"
server_key: "dc39c152f29302dba0c584809dd5df0e"
server_key_iv: "521537f6bf0686d0cfec0f3018a2052a"
server_key_version: "encryptionkey@0"
I20260806 04:50:11.986518 27296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:12.013021 27296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:12.017135 27296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:12.017423 27296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:12.018290 27296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:12.019814 27296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:12.019904 27296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:12.020031 27296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:12.020089 27296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:12.052464 27296 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:40201
I20260806 04:50:12.052536 27425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:40201 every 8 connection(s)
I20260806 04:50:12.053666 27296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:50:12.059413 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 27296
I20260806 04:50:12.059608 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:50:12.060056 7623 external_mini_cluster.cc:1428] Setting key f613eb78d8b928f18aefaeaab7fff524
Aug 06 04:50:12 dist-test-slave-0b58 krb5kdc[27188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991811, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.193@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:50:12.073704 27428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:12.056374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:60167 (local address 127.7.113.254:41827)
0806 04:50:12.056811 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:12.056815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:12.057696 (+ 881us) server_negotiation.cc:407] Connection header received
0806 04:50:12.059516 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:12.059522 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:12.059620 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:12.059745 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:12.061493 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:12.062545 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:12.064159 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:12.064932 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:12.065074 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:12.068324 (+ 3250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:12.068330 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:12.068334 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:12.068372 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:12.070772 (+ 2400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:12.071463 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:12.071469 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:12.071474 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:12.071598 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:12.072006 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:12.072012 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:12.072015 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:12.072325 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:12.072483 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:12.073122 (+ 639us) server_negotiation.cc:299] Negotiation successful
0806 04:50:12.073335 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":217,"threads_started":1}
I20260806 04:50:12.074507 27429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:12.056931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41827 (local address 127.7.113.193:60167)
0806 04:50:12.057546 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:12.057584 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:12.059263 (+ 1679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:12.059986 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:12.059993 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:12.060596 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:12.061325 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:12.061350 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:12.062701 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:12.062704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:12.064021 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:12.064036 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:12.065180 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:12.065188 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:12.065421 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:12.066048 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:12.066067 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:12.068113 (+ 2046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:12.070910 (+ 2797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:12.070917 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:12.070930 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:12.071346 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:12.071709 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:12.071713 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:12.071717 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:12.071890 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:12.072451 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:12.072458 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:12.072765 (+ 307us) client_negotiation.cc:769] Sending connection context
0806 04:50:12.073013 (+ 248us) client_negotiation.cc:240] Negotiation successful
0806 04:50:12.073483 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":255,"threads_started":1}
I20260806 04:50:12.076087 27426 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41827
I20260806 04:50:12.076416 27426 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:12.077039 27426 heartbeater.cc:511] Master 127.7.113.254:41827 requested a full tablet report, sending...
I20260806 04:50:12.078945 27234 ts_manager.cc:194] Registered new tserver with Master: 1b6f225409e748e9a3232131440d9309 (127.7.113.193:40201)
I20260806 04:50:12.080507 27234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.193@KRBTEST.COM'} at 127.7.113.193:60167
WARNING: no policy specified for kudu/127.7.113.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
Entry for principal kudu/127.7.113.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab.
I20260806 04:50:12.123893 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41827
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:41801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:12.448532 27432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:12.448786 27432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:12.448897 27432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:12.456089 27432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:12.456187 27432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:12.456349 27432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:50:12.465703 27432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:41801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.194.keytab
--principal=kudu/127.7.113.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41827
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:12.466815 27432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:12.468004 27432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:12.480609 27437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:12.480571 27438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:12.480654 27440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:12.481879 27432 server_base.cc:1034] running on GCE node
I20260806 04:50:12.482431 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:12.483610 27432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:12.484783 27432 hybrid_clock.cc:648] HybridClock initialized: now 1785991812484722 us; error 46 us; skew 500 ppm
I20260806 04:50:12.485147 27432 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:12 dist-test-slave-0b58 krb5kdc[27188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991812, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:12.488853 27432 init.cc:377] Logged in from keytab as kudu/127.7.113.194@KRBTEST.COM (short username kudu)
I20260806 04:50:12.490322 27432 webserver.cc:460] Webserver started at http://127.7.113.194:35669/ using document root <none> and password file <none>
I20260806 04:50:12.491024 27432 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:12.491168 27432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:12.491482 27432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:12.494199 27432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "0b1cc028fb52407fb5494bbc4524101e"
format_stamp: "Formatted at 2026-08-06 04:50:12 on dist-test-slave-0b58"
server_key: "64ee589e9bb3cced5b58d7bb558e800e"
server_key_iv: "112e455e4cadf60c6396efb675beb339"
server_key_version: "encryptionkey@0"
I20260806 04:50:12.494976 27432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "0b1cc028fb52407fb5494bbc4524101e"
format_stamp: "Formatted at 2026-08-06 04:50:12 on dist-test-slave-0b58"
server_key: "64ee589e9bb3cced5b58d7bb558e800e"
server_key_iv: "112e455e4cadf60c6396efb675beb339"
server_key_version: "encryptionkey@0"
I20260806 04:50:12.499737 27432 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260806 04:50:12.503153 27447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:12.504423 27432 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:50:12.504585 27432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "0b1cc028fb52407fb5494bbc4524101e"
format_stamp: "Formatted at 2026-08-06 04:50:12 on dist-test-slave-0b58"
server_key: "64ee589e9bb3cced5b58d7bb558e800e"
server_key_iv: "112e455e4cadf60c6396efb675beb339"
server_key_version: "encryptionkey@0"
I20260806 04:50:12.504770 27432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:12.518503 27432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:12.522217 27432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:12.522488 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:12.523375 27432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:12.524608 27432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:12.524705 27432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:12.524871 27432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:12.524948 27432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:12.557468 27432 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:35705
I20260806 04:50:12.557509 27560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:35705 every 8 connection(s)
I20260806 04:50:12.558681 27432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:50:12.559877 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 27432
I20260806 04:50:12.560092 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:50:12.560706 7623 external_mini_cluster.cc:1428] Setting key 4ec472b4b199e6c77172fd917fa4aa24
Aug 06 04:50:12 dist-test-slave-0b58 krb5kdc[27188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991812, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.194@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:50:12.583537 27428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:12.561630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:50661 (local address 127.7.113.254:41827)
0806 04:50:12.561863 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:12.561868 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:12.563265 (+ 1397us) server_negotiation.cc:407] Connection header received
0806 04:50:12.566155 (+ 2890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:12.566159 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:12.566240 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:12.566323 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:12.568338 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:12.569042 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:12.571757 (+ 2715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:12.572187 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:12.572370 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:12.576488 (+ 4118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:12.576493 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:12.576497 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:12.576528 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:12.580039 (+ 3511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:12.580804 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:12.580812 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:12.580819 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:12.580995 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:12.581522 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:12.581530 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:12.581537 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:12.581926 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:12.582082 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:12.582831 (+ 749us) server_negotiation.cc:299] Negotiation successful
0806 04:50:12.583108 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 04:50:12.584105 27563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:12.562206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41827 (local address 127.7.113.194:50661)
0806 04:50:12.563091 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:12.563150 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:12.565841 (+ 2691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:12.566583 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:12.566596 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:12.567358 (+ 762us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:12.568130 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:12.568157 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:12.569198 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:12.569206 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:12.571467 (+ 2261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:12.571485 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:12.572442 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:12.572451 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:12.572811 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:12.573538 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:12.573571 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:12.576219 (+ 2648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:12.580203 (+ 3984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:12.580209 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:12.580221 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:12.580687 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:12.581105 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:12.581108 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:12.581110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:12.581289 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:12.582047 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:12.582053 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:12.582433 (+ 380us) client_negotiation.cc:769] Sending connection context
0806 04:50:12.582648 (+ 215us) client_negotiation.cc:240] Negotiation successful
0806 04:50:12.583016 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":378,"threads_started":1}
I20260806 04:50:12.585608 27561 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41827
I20260806 04:50:12.585969 27561 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:12.586900 27561 heartbeater.cc:511] Master 127.7.113.254:41827 requested a full tablet report, sending...
I20260806 04:50:12.588531 27234 ts_manager.cc:194] Registered new tserver with Master: 0b1cc028fb52407fb5494bbc4524101e (127.7.113.194:35705)
I20260806 04:50:12.589358 27234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.194@KRBTEST.COM'} at 127.7.113.194:50661
WARNING: no policy specified for kudu/127.7.113.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
Entry for principal kudu/127.7.113.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab.
I20260806 04:50:12.635191 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41827
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:41801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:12.955798 27566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:12.956105 27566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:12.956319 27566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:12.963214 27566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:12.963304 27566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:12.963450 27566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:50:12.972792 27566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:41801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.195.keytab
--principal=kudu/127.7.113.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:41827
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:12.973939 27566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:12.975219 27566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:12.988099 27572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:12.988117 27574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:12.988274 27571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:12.988922 27566 server_base.cc:1034] running on GCE node
I20260806 04:50:12.989499 27566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:12.990352 27566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:12.991622 27566 hybrid_clock.cc:648] HybridClock initialized: now 1785991812991570 us; error 46 us; skew 500 ppm
I20260806 04:50:12.991957 27566 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:12 dist-test-slave-0b58 krb5kdc[27188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991812, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:12.994848 27566 init.cc:377] Logged in from keytab as kudu/127.7.113.195@KRBTEST.COM (short username kudu)
I20260806 04:50:12.996219 27566 webserver.cc:460] Webserver started at http://127.7.113.195:34673/ using document root <none> and password file <none>
I20260806 04:50:12.996882 27566 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:12.996976 27566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:12.997282 27566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:12.999935 27566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd"
format_stamp: "Formatted at 2026-08-06 04:50:12 on dist-test-slave-0b58"
server_key: "eed400c6543a6b95a01b25894fe0b5ed"
server_key_iv: "aeff9b8d466fafa2c68644145d257933"
server_key_version: "encryptionkey@0"
I20260806 04:50:13.000890 27566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd"
format_stamp: "Formatted at 2026-08-06 04:50:12 on dist-test-slave-0b58"
server_key: "eed400c6543a6b95a01b25894fe0b5ed"
server_key_iv: "aeff9b8d466fafa2c68644145d257933"
server_key_version: "encryptionkey@0"
I20260806 04:50:13.005678 27566 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 04:50:13.009109 27582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:13.010316 27566 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:50:13.010483 27566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd"
format_stamp: "Formatted at 2026-08-06 04:50:12 on dist-test-slave-0b58"
server_key: "eed400c6543a6b95a01b25894fe0b5ed"
server_key_iv: "aeff9b8d466fafa2c68644145d257933"
server_key_version: "encryptionkey@0"
I20260806 04:50:13.010676 27566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:13.028450 27566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:13.032013 27566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:13.032320 27566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:13.033224 27566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:13.034493 27566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:13.034597 27566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:13.034744 27566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:13.034819 27566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:13.068065 27566 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:41067
I20260806 04:50:13.068183 27695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:41067 every 8 connection(s)
I20260806 04:50:13.069316 27566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:50:13.071683 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 27566
I20260806 04:50:13.071890 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:50:13.072396 7623 external_mini_cluster.cc:1428] Setting key c4fe2aec7e1041bf8a310fa365ca9fc7
Aug 06 04:50:13 dist-test-slave-0b58 krb5kdc[27188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991812, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.195@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:50:13.083127 27426 heartbeater.cc:503] Master 127.7.113.254:41827 was elected leader, sending a full tablet report...
I20260806 04:50:13.089843 27428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.071855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:34349 (local address 127.7.113.254:41827)
0806 04:50:13.072069 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:13.072074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:13.073312 (+ 1238us) server_negotiation.cc:407] Connection header received
0806 04:50:13.075693 (+ 2381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:13.075697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:13.075759 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:13.075848 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:13.077509 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.078268 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.079702 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.080119 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.080209 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.083660 (+ 3451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:13.083666 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:13.083671 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:13.083709 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:13.087070 (+ 3361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:13.087908 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:13.087912 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:13.087914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:13.088036 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:13.088458 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:13.088461 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:13.088463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:13.088714 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:13.088826 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:13.089418 (+ 592us) server_negotiation.cc:299] Negotiation successful
0806 04:50:13.089571 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 04:50:13.090898 27698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.072320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:41827 (local address 127.7.113.195:34349)
0806 04:50:13.073111 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:13.073183 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:13.075401 (+ 2218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:13.076226 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:13.076233 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:13.076828 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:13.077360 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:13.077378 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.078387 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.078390 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:13.079584 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:13.079595 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.080362 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.080367 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:13.080547 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.081182 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:13.081207 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:13.083441 (+ 2234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:13.087207 (+ 3766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:13.087215 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:13.087229 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:13.087791 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:13.088123 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:13.088126 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:13.088128 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:13.088359 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:13.088818 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:13.088824 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:13.089105 (+ 281us) client_negotiation.cc:769] Sending connection context
0806 04:50:13.089312 (+ 207us) client_negotiation.cc:240] Negotiation successful
0806 04:50:13.089706 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":285,"threads_started":1}
I20260806 04:50:13.092090 27696 heartbeater.cc:347] Connected to a master server at 127.7.113.254:41827
I20260806 04:50:13.092391 27696 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:13.093075 27696 heartbeater.cc:511] Master 127.7.113.254:41827 requested a full tablet report, sending...
I20260806 04:50:13.094314 27234 ts_manager.cc:194] Registered new tserver with Master: 3aa65390ce3b4513bfe0e7bb8697b7dd (127.7.113.195:41067)
I20260806 04:50:13.095077 27234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.113.195@KRBTEST.COM'} at 127.7.113.195:34349
I20260806 04:50:13.099509 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:50:13.115388 27428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.103322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46744 (local address 127.7.113.254:41827)
0806 04:50:13.103475 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:13.103479 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:13.103979 (+ 500us) server_negotiation.cc:407] Connection header received
0806 04:50:13.104098 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:13.104101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:13.104154 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:13.104227 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:13.105584 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.106287 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.107531 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.107951 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.108071 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.110531 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:13.110535 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:13.110538 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:13.110567 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:13.113114 (+ 2547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:13.113670 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:13.113674 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:13.113676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:13.113834 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:13.114181 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:13.114184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:13.114186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:13.114475 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:13.114721 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:13.115013 (+ 292us) server_negotiation.cc:299] Negotiation successful
0806 04:50:13.115163 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 04:50:13.118934 27234 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46744:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:50:13.125538 27234 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:50:13.151892 27710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.137602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58710 (local address 127.7.113.193:40201)
0806 04:50:13.141194 (+ 3592us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:13.141205 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:13.141239 (+ 34us) server_negotiation.cc:407] Connection header received
0806 04:50:13.141366 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:13.141377 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:13.141667 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:13.142720 (+ 1053us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:13.142997 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.146316 (+ 3319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.149235 (+ 2919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.150665 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.150798 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.151043 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:13.151373 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 04:50:13.151550 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3371,"thread_start_us":1979,"threads_started":1}
I20260806 04:50:13.152231 27709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.137312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:40201 (local address 127.0.0.1:58710)
0806 04:50:13.138340 (+ 1028us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:13.138408 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:13.138596 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:13.141938 (+ 3342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:13.141949 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:13.141989 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:13.142486 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:13.142501 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.146496 (+ 3995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.146505 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:13.149051 (+ 2546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:13.149069 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.150875 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.150883 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:13.151087 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.151161 (+ 74us) client_negotiation.cc:769] Sending connection context
0806 04:50:13.151301 (+ 140us) client_negotiation.cc:240] Negotiation successful
0806 04:50:13.151559 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"mutex_wait_us":76,"thread_start_us":9038,"threads_started":1}
I20260806 04:50:13.155205 27708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.137397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:41067 (local address 127.0.0.1:55402)
0806 04:50:13.147396 (+ 9999us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:13.147411 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:13.147517 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:13.148293 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:13.148299 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:13.148325 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:13.149058 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:13.149069 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.150388 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.150395 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:13.152509 (+ 2114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:13.152526 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.154469 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.154474 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:13.154621 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.154649 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 04:50:13.154724 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 04:50:13.154836 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9105,"mutex_wait_us":2,"thread_start_us":721,"threads_started":1}
I20260806 04:50:13.155915 27711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.137947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55402 (local address 127.7.113.195:41067)
0806 04:50:13.139376 (+ 1429us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:13.139388 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:13.147519 (+ 8131us) server_negotiation.cc:407] Connection header received
0806 04:50:13.147630 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:13.147637 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:13.147838 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:13.148005 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:13.149276 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.150264 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.152688 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.153923 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.154041 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.154290 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:13.155478 (+ 1188us) server_negotiation.cc:299] Negotiation successful
0806 04:50:13.155618 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1195,"thread_start_us":1017,"threads_started":1}
I20260806 04:50:13.156159 27713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.140160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36764 (local address 127.7.113.194:35705)
0806 04:50:13.147064 (+ 6904us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:13.147072 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:13.147181 (+ 109us) server_negotiation.cc:407] Connection header received
0806 04:50:13.147399 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:13.147408 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:13.147637 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:13.147815 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:13.149298 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.150798 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.153876 (+ 3078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.155096 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.155232 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.155451 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:13.155690 (+ 239us) server_negotiation.cc:299] Negotiation successful
0806 04:50:13.155871 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6744,"thread_start_us":6726,"threads_started":1}
I20260806 04:50:13.156163 27712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.139936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:35705 (local address 127.0.0.1:36764)
0806 04:50:13.147063 (+ 7127us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:13.147080 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:13.147245 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:13.148252 (+ 1007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:13.148257 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:13.148300 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:13.149074 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:13.149086 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.150954 (+ 1868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.150962 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:13.153725 (+ 2763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:13.153737 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.155326 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.155332 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:13.155488 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.155521 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 04:50:13.155680 (+ 159us) client_negotiation.cc:240] Negotiation successful
0806 04:50:13.155812 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6985,"mutex_wait_us":29,"thread_start_us":6812,"threads_started":1}
I20260806 04:50:13.156225 27361 tablet_service.cc:1467] Processing CreateTablet for tablet 18437e99d95d49a0bf7eea5169cd258f (DEFAULT_TABLE table=test-table [id=1b30f73bab854074a201843bb210ccce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:13.157789 27361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18437e99d95d49a0bf7eea5169cd258f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:13.159389 27495 tablet_service.cc:1467] Processing CreateTablet for tablet 18437e99d95d49a0bf7eea5169cd258f (DEFAULT_TABLE table=test-table [id=1b30f73bab854074a201843bb210ccce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:13.160600 27495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18437e99d95d49a0bf7eea5169cd258f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:13.160367 27630 tablet_service.cc:1467] Processing CreateTablet for tablet 18437e99d95d49a0bf7eea5169cd258f (DEFAULT_TABLE table=test-table [id=1b30f73bab854074a201843bb210ccce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:13.161636 27630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18437e99d95d49a0bf7eea5169cd258f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:13.170768 27714 tablet_bootstrap.cc:492] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e: Bootstrap starting.
I20260806 04:50:13.173733 27714 tablet_bootstrap.cc:654] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:13.175369 27714 log.cc:824] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:13.177644 27715 tablet_bootstrap.cc:492] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309: Bootstrap starting.
I20260806 04:50:13.178313 27714 tablet_bootstrap.cc:492] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e: No bootstrap required, opened a new log
I20260806 04:50:13.178561 27714 ts_tablet_manager.cc:1397] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260806 04:50:13.180377 27715 tablet_bootstrap.cc:654] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:13.181248 27715 log.cc:824] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:13.182016 27717 tablet_bootstrap.cc:492] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd: Bootstrap starting.
I20260806 04:50:13.184634 27717 tablet_bootstrap.cc:654] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:13.184865 27715 tablet_bootstrap.cc:492] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309: No bootstrap required, opened a new log
I20260806 04:50:13.185134 27715 ts_tablet_manager.cc:1397] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.004s
I20260806 04:50:13.185732 27717 log.cc:824] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:13.188056 27717 tablet_bootstrap.cc:492] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd: No bootstrap required, opened a new log
I20260806 04:50:13.187770 27714 raft_consensus.cc:348] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b6f225409e748e9a3232131440d9309" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 40201 } } peers { permanent_uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41067 } } peers { permanent_uuid: "0b1cc028fb52407fb5494bbc4524101e" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35705 } }
I20260806 04:50:13.188194 27714 raft_consensus.cc:374] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:13.188321 27714 raft_consensus.cc:729] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b1cc028fb52407fb5494bbc4524101e, State: Initialized, Role: FOLLOWER
I20260806 04:50:13.188375 27717 ts_tablet_manager.cc:1397] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.002s
I20260806 04:50:13.188905 27714 consensus_queue.cc:260] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b6f225409e748e9a3232131440d9309" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 40201 } } peers { permanent_uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41067 } } peers { permanent_uuid: "0b1cc028fb52407fb5494bbc4524101e" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35705 } }
I20260806 04:50:13.190006 27561 heartbeater.cc:503] Master 127.7.113.254:41827 was elected leader, sending a full tablet report...
I20260806 04:50:13.191839 27714 ts_tablet_manager.cc:1428] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
I20260806 04:50:13.194769 27715 raft_consensus.cc:348] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b6f225409e748e9a3232131440d9309" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 40201 } } peers { permanent_uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41067 } } peers { permanent_uuid: "0b1cc028fb52407fb5494bbc4524101e" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35705 } }
I20260806 04:50:13.195158 27715 raft_consensus.cc:374] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:13.195263 27715 raft_consensus.cc:729] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b6f225409e748e9a3232131440d9309, State: Initialized, Role: FOLLOWER
I20260806 04:50:13.195856 27715 consensus_queue.cc:260] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b6f225409e748e9a3232131440d9309" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 40201 } } peers { permanent_uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41067 } } peers { permanent_uuid: "0b1cc028fb52407fb5494bbc4524101e" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35705 } }
I20260806 04:50:13.197149 27715 ts_tablet_manager.cc:1428] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260806 04:50:13.197510 27717 raft_consensus.cc:348] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b6f225409e748e9a3232131440d9309" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 40201 } } peers { permanent_uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41067 } } peers { permanent_uuid: "0b1cc028fb52407fb5494bbc4524101e" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35705 } }
I20260806 04:50:13.197880 27717 raft_consensus.cc:374] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:13.197976 27717 raft_consensus.cc:729] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3aa65390ce3b4513bfe0e7bb8697b7dd, State: Initialized, Role: FOLLOWER
I20260806 04:50:13.198516 27717 consensus_queue.cc:260] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b6f225409e748e9a3232131440d9309" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 40201 } } peers { permanent_uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41067 } } peers { permanent_uuid: "0b1cc028fb52407fb5494bbc4524101e" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35705 } }
I20260806 04:50:13.199532 27696 heartbeater.cc:503] Master 127.7.113.254:41827 was elected leader, sending a full tablet report...
I20260806 04:50:13.200116 27717 ts_tablet_manager.cc:1428] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd: Time spent starting tablet: real 0.012s user 0.010s sys 0.001s
I20260806 04:50:13.200219 27721 raft_consensus.cc:482] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:50:13.200484 27721 raft_consensus.cc:504] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b6f225409e748e9a3232131440d9309" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 40201 } } peers { permanent_uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41067 } } peers { permanent_uuid: "0b1cc028fb52407fb5494bbc4524101e" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35705 } }
I20260806 04:50:13.202348 27721 leader_election.cc:288] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3aa65390ce3b4513bfe0e7bb8697b7dd (127.7.113.195:41067), 0b1cc028fb52407fb5494bbc4524101e (127.7.113.194:35705)
I20260806 04:50:13.210331 27711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.202674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:44163 (local address 127.7.113.195:41067)
0806 04:50:13.202865 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:13.202873 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:13.203382 (+ 509us) server_negotiation.cc:407] Connection header received
0806 04:50:13.203583 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:13.203588 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:13.203662 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:13.203753 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:13.204542 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.205559 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.208116 (+ 2557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.209395 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.209552 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.209625 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:13.209967 (+ 342us) server_negotiation.cc:299] Negotiation successful
0806 04:50:13.210057 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 04:50:13.210510 27723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.202695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:41067 (local address 127.7.113.193:44163)
0806 04:50:13.203275 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:13.203289 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:13.203436 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:13.203950 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:13.203954 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:13.203979 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:13.204408 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:13.204420 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.205677 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.205680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:13.207952 (+ 2272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:13.207967 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.209615 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.209620 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:13.209801 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.209841 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 04:50:13.209936 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 04:50:13.210066 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":23,"thread_start_us":348,"threads_started":1}
I20260806 04:50:13.210525 27713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.203854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:52343 (local address 127.7.113.194:35705)
0806 04:50:13.204048 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:13.204053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:13.204188 (+ 135us) server_negotiation.cc:407] Connection header received
0806 04:50:13.204439 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:13.204443 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:13.204527 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:13.204625 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:13.205083 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.205944 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.208355 (+ 2411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.209628 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.209755 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.209800 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:13.210161 (+ 361us) server_negotiation.cc:299] Negotiation successful
0806 04:50:13.210279 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 04:50:13.210866 27724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.203498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:35705 (local address 127.7.113.193:52343)
0806 04:50:13.204091 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:13.204109 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:13.204312 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:13.204639 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:13.204642 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:13.204660 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:13.204933 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:13.204940 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.206057 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.206066 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:13.208193 (+ 2127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:13.208203 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.209828 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.209834 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:13.210002 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.210032 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 04:50:13.210123 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 04:50:13.210240 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"mutex_wait_us":3,"thread_start_us":554,"threads_started":1}
I20260806 04:50:13.211561 27650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18437e99d95d49a0bf7eea5169cd258f" candidate_uuid: "1b6f225409e748e9a3232131440d9309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd" is_pre_election: true
I20260806 04:50:13.211619 27516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18437e99d95d49a0bf7eea5169cd258f" candidate_uuid: "1b6f225409e748e9a3232131440d9309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b1cc028fb52407fb5494bbc4524101e" is_pre_election: true
I20260806 04:50:13.212057 27650 raft_consensus.cc:2454] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b6f225409e748e9a3232131440d9309 in term 0.
I20260806 04:50:13.212078 27516 raft_consensus.cc:2454] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b6f225409e748e9a3232131440d9309 in term 0.
I20260806 04:50:13.212723 27314 leader_election.cc:302] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b1cc028fb52407fb5494bbc4524101e, 1b6f225409e748e9a3232131440d9309; no voters:
I20260806 04:50:13.213104 27721 raft_consensus.cc:2781] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:50:13.213261 27721 raft_consensus.cc:482] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:50:13.213390 27721 raft_consensus.cc:3037] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:13.215627 27721 raft_consensus.cc:504] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b6f225409e748e9a3232131440d9309" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 40201 } } peers { permanent_uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41067 } } peers { permanent_uuid: "0b1cc028fb52407fb5494bbc4524101e" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35705 } }
I20260806 04:50:13.216157 27721 leader_election.cc:288] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [CANDIDATE]: Term 1 election: Requested vote from peers 3aa65390ce3b4513bfe0e7bb8697b7dd (127.7.113.195:41067), 0b1cc028fb52407fb5494bbc4524101e (127.7.113.194:35705)
I20260806 04:50:13.216571 27650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18437e99d95d49a0bf7eea5169cd258f" candidate_uuid: "1b6f225409e748e9a3232131440d9309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd"
I20260806 04:50:13.216589 27516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18437e99d95d49a0bf7eea5169cd258f" candidate_uuid: "1b6f225409e748e9a3232131440d9309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b1cc028fb52407fb5494bbc4524101e"
I20260806 04:50:13.216778 27650 raft_consensus.cc:3037] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:13.216792 27516 raft_consensus.cc:3037] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:13.218917 27516 raft_consensus.cc:2454] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b6f225409e748e9a3232131440d9309 in term 1.
I20260806 04:50:13.218920 27650 raft_consensus.cc:2454] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b6f225409e748e9a3232131440d9309 in term 1.
I20260806 04:50:13.219282 27314 leader_election.cc:302] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b1cc028fb52407fb5494bbc4524101e, 1b6f225409e748e9a3232131440d9309; no voters:
I20260806 04:50:13.219586 27721 raft_consensus.cc:2781] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:13.220019 27721 raft_consensus.cc:686] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [term 1 LEADER]: Becoming Leader. State: Replica: 1b6f225409e748e9a3232131440d9309, State: Running, Role: LEADER
I20260806 04:50:13.220515 27721 consensus_queue.cc:237] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b6f225409e748e9a3232131440d9309" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 40201 } } peers { permanent_uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41067 } } peers { permanent_uuid: "0b1cc028fb52407fb5494bbc4524101e" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35705 } }
I20260806 04:50:13.224551 27233 catalog_manager.cc:5495] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b6f225409e748e9a3232131440d9309 (127.7.113.193). New cstate: current_term: 1 leader_uuid: "1b6f225409e748e9a3232131440d9309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b6f225409e748e9a3232131440d9309" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 40201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b1cc028fb52407fb5494bbc4524101e" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35705 } health_report { overall_health: UNKNOWN } } }
I20260806 04:50:13.243983 27710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.239094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58718 (local address 127.7.113.193:40201)
0806 04:50:13.239266 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:13.239270 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:13.239286 (+ 16us) server_negotiation.cc:407] Connection header received
0806 04:50:13.239491 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:13.239495 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:13.239567 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:13.239691 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:50:13.240003 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.240784 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.242131 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.242528 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.242618 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.243015 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:50:13.243463 (+ 448us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:50:13.243571 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:13.243640 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 04:50:13.243698 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 04:50:13.251595 27650 raft_consensus.cc:1261] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd [term 1 FOLLOWER]: Refusing update from remote peer 1b6f225409e748e9a3232131440d9309: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:50:13.251634 27516 raft_consensus.cc:1261] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e [term 1 FOLLOWER]: Refusing update from remote peer 1b6f225409e748e9a3232131440d9309: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:50:13.252588 27725 consensus_queue.cc:1035] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b1cc028fb52407fb5494bbc4524101e" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 35705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:50:13.252981 27721 consensus_queue.cc:1035] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3aa65390ce3b4513bfe0e7bb8697b7dd" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 41067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:50:13.267731 27729 mvcc.cc:205] Tried to move back new op lower bound from 7315422467068915712 to 7315422466954387456. Current Snapshot: MvccSnapshot[applied={T|T < 7315422467068915712}]
I20260806 04:50:13.278010 27234 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:50:13.278319 27234 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:50:13.281842 27234 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6dd433e97c9b46c0b25268ce80a6ef04: Sending DeleteTablet for 3 replicas of tablet 18437e99d95d49a0bf7eea5169cd258f
I20260806 04:50:13.282939 27361 tablet_service.cc:1514] Processing DeleteTablet for tablet 18437e99d95d49a0bf7eea5169cd258f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:13 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:58710
I20260806 04:50:13.283190 27495 tablet_service.cc:1514] Processing DeleteTablet for tablet 18437e99d95d49a0bf7eea5169cd258f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:13 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:36764
I20260806 04:50:13.283972 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 27296
I20260806 04:50:13.284076 27630 tablet_service.cc:1514] Processing DeleteTablet for tablet 18437e99d95d49a0bf7eea5169cd258f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:13 UTC) from {username='kudu', principal='kudu/127.7.113.254@KRBTEST.COM'} at 127.0.0.1:55402
I20260806 04:50:13.292860 27739 tablet_replica.cc:330] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd: stopping tablet replica
I20260806 04:50:13.293273 27739 raft_consensus.cc:2229] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:50:13.293781 27739 raft_consensus.cc:2258] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:13.298988 27738 tablet_replica.cc:330] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e: stopping tablet replica
I20260806 04:50:13.299247 27737 tablet_replica.cc:330] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309: stopping tablet replica
I20260806 04:50:13.299386 27738 raft_consensus.cc:2229] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:50:13.299636 27737 raft_consensus.cc:2229] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:50:13.299840 27738 raft_consensus.cc:2258] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:13.300298 27737 raft_consensus.cc:2258] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:13.301826 27739 ts_tablet_manager.cc:1905] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:13.302394 27737 ts_tablet_manager.cc:1905] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:13.304633 27738 ts_tablet_manager.cc:1905] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:13.308738 27739 ts_tablet_manager.cc:1918] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:50:13.308974 27739 log.cc:1196] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/18437e99d95d49a0bf7eea5169cd258f
I20260806 04:50:13.309589 27739 ts_tablet_manager.cc:1939] T 18437e99d95d49a0bf7eea5169cd258f P 3aa65390ce3b4513bfe0e7bb8697b7dd: Deleting consensus metadata
I20260806 04:50:13.310475 27737 ts_tablet_manager.cc:1918] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:50:13.310698 27737 log.cc:1196] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-0/wal/wals/18437e99d95d49a0bf7eea5169cd258f
I20260806 04:50:13.311303 27737 ts_tablet_manager.cc:1939] T 18437e99d95d49a0bf7eea5169cd258f P 1b6f225409e748e9a3232131440d9309: Deleting consensus metadata
I20260806 04:50:13.311302 27220 catalog_manager.cc:4841] TS 3aa65390ce3b4513bfe0e7bb8697b7dd (127.7.113.195:41067): tablet 18437e99d95d49a0bf7eea5169cd258f (table test-table [id=1b30f73bab854074a201843bb210ccce]) successfully deleted
I20260806 04:50:13.313103 27219 catalog_manager.cc:4841] TS 1b6f225409e748e9a3232131440d9309 (127.7.113.193:40201): tablet 18437e99d95d49a0bf7eea5169cd258f (table test-table [id=1b30f73bab854074a201843bb210ccce]) successfully deleted
I20260806 04:50:13.313817 27738 ts_tablet_manager.cc:1918] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:50:13.313993 27738 log.cc:1196] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/18437e99d95d49a0bf7eea5169cd258f
I20260806 04:50:13.314535 27738 ts_tablet_manager.cc:1939] T 18437e99d95d49a0bf7eea5169cd258f P 0b1cc028fb52407fb5494bbc4524101e: Deleting consensus metadata
Aug 06 04:50:13 dist-test-slave-0b58 krb5kdc[27188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.193@KRBTEST.COM
I20260806 04:50:13.315989 27220 catalog_manager.cc:4841] TS 0b1cc028fb52407fb5494bbc4524101e (127.7.113.194:35705): tablet 18437e99d95d49a0bf7eea5169cd258f (table test-table [id=1b30f73bab854074a201843bb210ccce]) successfully deleted
I20260806 04:50:13.322217 27710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.285490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58720 (local address 127.7.113.193:40201)
0806 04:50:13.285719 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:13.285728 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:13.295597 (+ 9869us) server_negotiation.cc:407] Connection header received
0806 04:50:13.296080 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:13.296088 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:13.296185 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:13.296287 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:13.300237 (+ 3950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.301431 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.307735 (+ 6304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.308526 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.308631 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.316379 (+ 7748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:13.316390 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:13.316402 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:13.316436 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:13.319268 (+ 2832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:13.319940 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:13.319946 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:13.319949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:13.320139 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:13.320627 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:13.320631 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:13.320635 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:13.321029 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:13.321304 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:13.321633 (+ 329us) server_negotiation.cc:299] Negotiation successful
0806 04:50:13.321856 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 04:50:13.322894 27421 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:13.420181 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 27296
I20260806 04:50:13.442950 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 27432
Aug 06 04:50:13 dist-test-slave-0b58 krb5kdc[27188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.194@KRBTEST.COM
I20260806 04:50:13.458375 27713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.443673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36780 (local address 127.7.113.194:35705)
0806 04:50:13.443832 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:13.443837 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:13.443863 (+ 26us) server_negotiation.cc:407] Connection header received
0806 04:50:13.443987 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:13.443990 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:13.444057 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:13.444136 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:13.445447 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.446159 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.447421 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.447802 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.447897 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.452446 (+ 4549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:13.452459 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:13.452473 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:13.452503 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:13.455520 (+ 3017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:13.456183 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:13.456199 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:13.456201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:13.456454 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:13.456830 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:13.456838 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:13.456841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:13.457196 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:13.457497 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:13.457825 (+ 328us) server_negotiation.cc:299] Negotiation successful
0806 04:50:13.458037 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 04:50:13.459002 27556 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:13.548065 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 27432
I20260806 04:50:13.566767 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 27566
Aug 06 04:50:13 dist-test-slave-0b58 krb5kdc[27188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.195@KRBTEST.COM
I20260806 04:50:13.581250 27711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:13.567585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55418 (local address 127.7.113.195:41067)
0806 04:50:13.567791 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:13.567796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:13.567814 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:50:13.567932 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:13.567936 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:13.568006 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:13.568086 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:13.569499 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.570243 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.571483 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:13.571871 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:13.571960 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:13.576198 (+ 4238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:13.576212 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:13.576228 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:13.576318 (+ 90us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:13.578768 (+ 2450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:13.579381 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:13.579387 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:13.579389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:13.579509 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:13.579810 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:13.579813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:13.579815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:13.580155 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:13.580430 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:13.580744 (+ 314us) server_negotiation.cc:299] Negotiation successful
0806 04:50:13.580901 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 04:50:13.581889 27691 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:13.669809 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 27566
I20260806 04:50:13.687951 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 27202
I20260806 04:50:13.689105 27265 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:13.800431 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 27202
2026-08-06T04:50:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4248 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-06T04:50:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:13Z Disabled control of system clock
I20260806 04:50:13.890549 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:45697
--webserver_interface=127.7.113.254
--webserver_port=0
--builtin_ntp_servers=127.7.113.212:41263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:45697
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 04:50:14.226037 27748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:14.226363 27748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:14.226539 27748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:14.234957 27748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:14.235049 27748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:14.235133 27748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:14.235239 27748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:14.235304 27748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:14.244376 27748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:41263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:45697
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:45697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:14.245514 27748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:14.247304 27748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:14.257488 27753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:14.258163 27754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:14.259182 27756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:14.259461 27748 server_base.cc:1034] running on GCE node
I20260806 04:50:14.260171 27748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:14.261456 27748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:14.262673 27748 hybrid_clock.cc:648] HybridClock initialized: now 1785991814262634 us; error 48 us; skew 500 ppm
I20260806 04:50:14.263068 27748 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:50:14.265321 27748 webserver.cc:460] Webserver started at http://127.7.113.254:44591/ using document root <none> and password file <none>
I20260806 04:50:14.265974 27748 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:14.266131 27748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:14.266461 27748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:14.269268 27748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "cfa951d067824e3ebe63f1b73bce4905"
format_stamp: "Formatted at 2026-08-06 04:50:14 on dist-test-slave-0b58"
server_key: "693f7ccfc4b74d5755350392c38e0a5a"
server_key_iv: "3607413124c849eab104f08ff3b62ff2"
server_key_version: "encryptionkey@0"
I20260806 04:50:14.270040 27748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "cfa951d067824e3ebe63f1b73bce4905"
format_stamp: "Formatted at 2026-08-06 04:50:14 on dist-test-slave-0b58"
server_key: "693f7ccfc4b74d5755350392c38e0a5a"
server_key_iv: "3607413124c849eab104f08ff3b62ff2"
server_key_version: "encryptionkey@0"
I20260806 04:50:14.274950 27748 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 04:50:14.278134 27762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:14.279287 27748 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 04:50:14.279470 27748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "cfa951d067824e3ebe63f1b73bce4905"
format_stamp: "Formatted at 2026-08-06 04:50:14 on dist-test-slave-0b58"
server_key: "693f7ccfc4b74d5755350392c38e0a5a"
server_key_iv: "3607413124c849eab104f08ff3b62ff2"
server_key_version: "encryptionkey@0"
I20260806 04:50:14.279675 27748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:14.301398 27748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:14.302168 27748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:14.302453 27748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:14.320513 27748 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:45697
I20260806 04:50:14.320538 27813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:45697 every 8 connection(s)
I20260806 04:50:14.321784 27748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:14.325237 27814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:14.327526 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 27748
I20260806 04:50:14.327708 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:14.328143 7623 external_mini_cluster.cc:1428] Setting key 431556e5ee9d677d7f1f29b8e9a42070
I20260806 04:50:14.336048 27814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905: Bootstrap starting.
I20260806 04:50:14.339118 27814 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:14.340167 27814 log.cc:824] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:14.341513 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:14.330019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36596 (local address 127.7.113.254:45697)
0806 04:50:14.330989 (+ 970us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:14.330998 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:14.331037 (+ 39us) server_negotiation.cc:407] Connection header received
0806 04:50:14.332768 (+ 1731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:14.332788 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:14.333197 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:14.333564 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:14.334157 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:14.335380 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:14.336880 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:14.337563 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:14.337778 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:14.338926 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:14.338933 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:14.338946 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:14.339495 (+ 549us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:14.339582 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:14.339602 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:14.339732 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:14.339952 (+ 220us) server_negotiation.cc:299] Negotiation successful
0806 04:50:14.340234 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":391,"threads_started":1}
I20260806 04:50:14.342962 27814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905: No bootstrap required, opened a new log
I20260806 04:50:14.350544 27814 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfa951d067824e3ebe63f1b73bce4905" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45697 } }
I20260806 04:50:14.350876 27814 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:14.350996 27814 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfa951d067824e3ebe63f1b73bce4905, State: Initialized, Role: FOLLOWER
I20260806 04:50:14.351540 27814 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfa951d067824e3ebe63f1b73bce4905" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45697 } }
I20260806 04:50:14.351804 27814 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:14.351998 27814 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:14.352195 27814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:14.354161 27814 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfa951d067824e3ebe63f1b73bce4905" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45697 } }
I20260806 04:50:14.354622 27814 leader_election.cc:302] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfa951d067824e3ebe63f1b73bce4905; no voters:
I20260806 04:50:14.355156 27814 leader_election.cc:288] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:14.355365 27819 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:14.356118 27819 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [term 1 LEADER]: Becoming Leader. State: Replica: cfa951d067824e3ebe63f1b73bce4905, State: Running, Role: LEADER
I20260806 04:50:14.356644 27819 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfa951d067824e3ebe63f1b73bce4905" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45697 } }
I20260806 04:50:14.357123 27814 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:14.359416 27820 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cfa951d067824e3ebe63f1b73bce4905" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfa951d067824e3ebe63f1b73bce4905" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45697 } } }
I20260806 04:50:14.359895 27820 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:14.359467 27821 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfa951d067824e3ebe63f1b73bce4905. Latest consensus state: current_term: 1 leader_uuid: "cfa951d067824e3ebe63f1b73bce4905" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfa951d067824e3ebe63f1b73bce4905" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45697 } } }
I20260806 04:50:14.360857 27821 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:14.362525 27827 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:14.366926 27827 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:14.374976 27827 catalog_manager.cc:1347] Generated new cluster ID: 1dc07692793d4b57b90bfb4af08a20ad
I20260806 04:50:14.375066 27827 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:14.385191 27827 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:14.386566 27827 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:14.391216 27827 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905: Generated new TSK 0
I20260806 04:50:14.391921 27827 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:14.399117 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.193:0
--local_ip_for_outbound_sockets=127.7.113.193
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45697
--builtin_ntp_servers=127.7.113.212:41263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 04:50:14.726405 27838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:14.726658 27838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:14.726750 27838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:14.733544 27838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:14.733665 27838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:14.733839 27838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.193
I20260806 04:50:14.742347 27838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:41263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.113.193
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.193
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:14.743494 27838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:14.745110 27838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:14.757927 27846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:14.757948 27844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:14.758118 27843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:14.758865 27838 server_base.cc:1034] running on GCE node
I20260806 04:50:14.759387 27838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:14.760206 27838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:14.761452 27838 hybrid_clock.cc:648] HybridClock initialized: now 1785991814761404 us; error 42 us; skew 500 ppm
I20260806 04:50:14.761751 27838 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:50:14.763841 27838 webserver.cc:460] Webserver started at http://127.7.113.193:38403/ using document root <none> and password file <none>
I20260806 04:50:14.764554 27838 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:14.764700 27838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:14.765025 27838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:14.767706 27838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/data/instance:
uuid: "40184763d40c4950859a6f89450fee3a"
format_stamp: "Formatted at 2026-08-06 04:50:14 on dist-test-slave-0b58"
server_key: "c6b5a1433b08b96164c7503063d9490f"
server_key_iv: "d992652903dfcd4ce30cdeae7d2767cb"
server_key_version: "encryptionkey@0"
I20260806 04:50:14.768638 27838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance:
uuid: "40184763d40c4950859a6f89450fee3a"
format_stamp: "Formatted at 2026-08-06 04:50:14 on dist-test-slave-0b58"
server_key: "c6b5a1433b08b96164c7503063d9490f"
server_key_iv: "d992652903dfcd4ce30cdeae7d2767cb"
server_key_version: "encryptionkey@0"
I20260806 04:50:14.773381 27838 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 04:50:14.776592 27852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:14.777774 27838 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 04:50:14.777940 27838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/wal
uuid: "40184763d40c4950859a6f89450fee3a"
format_stamp: "Formatted at 2026-08-06 04:50:14 on dist-test-slave-0b58"
server_key: "c6b5a1433b08b96164c7503063d9490f"
server_key_iv: "d992652903dfcd4ce30cdeae7d2767cb"
server_key_version: "encryptionkey@0"
I20260806 04:50:14.778147 27838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:14.817421 27838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:14.818320 27838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:14.818645 27838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:14.819638 27838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:14.821134 27838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:14.821265 27838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:14.821398 27838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:14.821489 27838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:14.854417 27838 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.193:43487
I20260806 04:50:14.854511 27965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.193:43487 every 8 connection(s)
I20260806 04:50:14.855656 27838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/data/info.pb
I20260806 04:50:14.858868 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 27838
I20260806 04:50:14.859088 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-0/wal/instance
I20260806 04:50:14.859670 7623 external_mini_cluster.cc:1428] Setting key ec9f8b691122934b4eed7a1a49f36325
I20260806 04:50:14.862632 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.194:0
--local_ip_for_outbound_sockets=127.7.113.194
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45697
--builtin_ntp_servers=127.7.113.212:41263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 04:50:14.869719 27968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:14.858223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:37153 (local address 127.7.113.254:45697)
0806 04:50:14.858740 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:14.858747 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:14.860117 (+ 1370us) server_negotiation.cc:407] Connection header received
0806 04:50:14.862341 (+ 2224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:14.862344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:14.862406 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:14.862486 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:14.863840 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:14.864657 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:14.866979 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:14.867361 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:14.867474 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:14.869000 (+ 1526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:14.869023 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:14.869026 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:14.869042 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:14.869081 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:14.869092 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:14.869158 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:14.869410 (+ 252us) server_negotiation.cc:299] Negotiation successful
0806 04:50:14.869481 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":227,"threads_started":1}
I20260806 04:50:14.871116 27969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:14.858789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45697 (local address 127.7.113.193:37153)
0806 04:50:14.859939 (+ 1150us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:14.859994 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:14.862045 (+ 2051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:14.862756 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:14.862768 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:14.862893 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:14.863653 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:14.863680 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:14.864802 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:14.864809 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:14.866845 (+ 2036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:14.866863 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:14.867592 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:14.867618 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:14.867931 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:14.868651 (+ 720us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:50:14.868656 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:14.868705 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:50:14.868808 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:14.869187 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:14.869206 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:14.869218 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 04:50:14.869394 (+ 176us) client_negotiation.cc:240] Negotiation successful
0806 04:50:14.869787 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":378,"threads_started":1}
I20260806 04:50:14.872529 27966 heartbeater.cc:347] Connected to a master server at 127.7.113.254:45697
I20260806 04:50:14.872818 27966 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:14.873490 27966 heartbeater.cc:511] Master 127.7.113.254:45697 requested a full tablet report, sending...
I20260806 04:50:14.875312 27779 ts_manager.cc:194] Registered new tserver with Master: 40184763d40c4950859a6f89450fee3a (127.7.113.193:43487)
I20260806 04:50:14.877305 27779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.113.193:37153
W20260806 04:50:15.194746 27970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:15.195010 27970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:15.195094 27970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:15.201968 27970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:15.202060 27970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:15.202162 27970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.194
I20260806 04:50:15.210958 27970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:41263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.113.194
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.194
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:15.212114 27970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:15.213945 27970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:15.226905 27976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:15.226938 27975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:15.227005 27978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:15.229564 27970 server_base.cc:1034] running on GCE node
I20260806 04:50:15.230150 27970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:15.231115 27970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:15.232395 27970 hybrid_clock.cc:648] HybridClock initialized: now 1785991815232338 us; error 40 us; skew 500 ppm
I20260806 04:50:15.232774 27970 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:50:15.234902 27970 webserver.cc:460] Webserver started at http://127.7.113.194:40077/ using document root <none> and password file <none>
I20260806 04:50:15.235570 27970 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:15.235703 27970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:15.236032 27970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:15.238870 27970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/data/instance:
uuid: "356067eceeaa4bd19db66d1f1c4acb74"
format_stamp: "Formatted at 2026-08-06 04:50:15 on dist-test-slave-0b58"
server_key: "06a90370aedf6a0ed64a223434f201ac"
server_key_iv: "540e5b50c36ff36d23ce62f94b3028c3"
server_key_version: "encryptionkey@0"
I20260806 04:50:15.239647 27970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance:
uuid: "356067eceeaa4bd19db66d1f1c4acb74"
format_stamp: "Formatted at 2026-08-06 04:50:15 on dist-test-slave-0b58"
server_key: "06a90370aedf6a0ed64a223434f201ac"
server_key_iv: "540e5b50c36ff36d23ce62f94b3028c3"
server_key_version: "encryptionkey@0"
I20260806 04:50:15.244597 27970 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 04:50:15.247812 27984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:15.249089 27970 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:50:15.249258 27970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/wal
uuid: "356067eceeaa4bd19db66d1f1c4acb74"
format_stamp: "Formatted at 2026-08-06 04:50:15 on dist-test-slave-0b58"
server_key: "06a90370aedf6a0ed64a223434f201ac"
server_key_iv: "540e5b50c36ff36d23ce62f94b3028c3"
server_key_version: "encryptionkey@0"
I20260806 04:50:15.249475 27970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:15.260707 27970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:15.261408 27970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:15.261689 27970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:15.262544 27970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:15.263906 27970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:15.264039 27970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:15.264164 27970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:15.264252 27970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:15.297261 27970 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.194:39343
I20260806 04:50:15.297312 28096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.194:39343 every 8 connection(s)
I20260806 04:50:15.298525 27970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/data/info.pb
I20260806 04:50:15.305285 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 27970
I20260806 04:50:15.305480 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/wal/instance
I20260806 04:50:15.306044 7623 external_mini_cluster.cc:1428] Setting key 2c83295a84f54024fc60081e1ed82b86
I20260806 04:50:15.308930 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.113.195:0
--local_ip_for_outbound_sockets=127.7.113.195
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45697
--builtin_ntp_servers=127.7.113.212:41263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 04:50:15.311358 27968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:15.300994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.194:43137 (local address 127.7.113.254:45697)
0806 04:50:15.301169 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:15.301173 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:15.302418 (+ 1245us) server_negotiation.cc:407] Connection header received
0806 04:50:15.304157 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:15.304163 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:15.304251 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:15.304411 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:15.305439 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.306562 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.308389 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.309046 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.309203 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:15.310484 (+ 1281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:15.310493 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:15.310501 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:15.310525 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:15.310568 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:15.310585 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:15.310677 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:15.310872 (+ 195us) server_negotiation.cc:299] Negotiation successful
0806 04:50:15.310976 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 04:50:15.312132 28099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:15.301444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45697 (local address 127.7.113.194:43137)
0806 04:50:15.302267 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:15.302306 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:15.303902 (+ 1596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:15.304634 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:15.304641 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:15.304718 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:15.305249 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:15.305266 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.306753 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.306758 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:15.308209 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:15.308220 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.309318 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.309323 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:15.309514 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:15.310174 (+ 660us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:50:15.310177 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:15.310213 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:50:15.310288 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:15.310680 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:15.310688 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:15.310693 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 04:50:15.310824 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 04:50:15.311078 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":268,"threads_started":1}
I20260806 04:50:15.313535 28097 heartbeater.cc:347] Connected to a master server at 127.7.113.254:45697
I20260806 04:50:15.313822 28097 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:15.314640 28097 heartbeater.cc:511] Master 127.7.113.254:45697 requested a full tablet report, sending...
I20260806 04:50:15.316025 27779 ts_manager.cc:194] Registered new tserver with Master: 356067eceeaa4bd19db66d1f1c4acb74 (127.7.113.194:39343)
I20260806 04:50:15.316857 27779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.113.194:43137
W20260806 04:50:15.636444 28100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:15.636796 28100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:15.636943 28100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:15.644100 28100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:15.644193 28100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:15.644410 28100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.113.195
I20260806 04:50:15.653709 28100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:41263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.113.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.113.195
--webserver_port=0
--tserver_master_addrs=127.7.113.254:45697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.113.195
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:15.655019 28100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:15.656896 28100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:15.669878 28105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:15.669899 28106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:15.669872 28108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:15.671015 28100 server_base.cc:1034] running on GCE node
I20260806 04:50:15.671624 28100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:15.672596 28100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:15.673822 28100 hybrid_clock.cc:648] HybridClock initialized: now 1785991815673786 us; error 52 us; skew 500 ppm
I20260806 04:50:15.674130 28100 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 04:50:15.676208 28100 webserver.cc:460] Webserver started at http://127.7.113.195:35593/ using document root <none> and password file <none>
I20260806 04:50:15.676916 28100 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:15.677049 28100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:15.677369 28100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:15.680078 28100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/data/instance:
uuid: "8ecc45b5ef014527915503dbba3f1232"
format_stamp: "Formatted at 2026-08-06 04:50:15 on dist-test-slave-0b58"
server_key: "5fa5afa62cedd18090e9d17735ceb920"
server_key_iv: "46bcfb7319d265d5f3be9e4d893533cc"
server_key_version: "encryptionkey@0"
I20260806 04:50:15.680917 28100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance:
uuid: "8ecc45b5ef014527915503dbba3f1232"
format_stamp: "Formatted at 2026-08-06 04:50:15 on dist-test-slave-0b58"
server_key: "5fa5afa62cedd18090e9d17735ceb920"
server_key_iv: "46bcfb7319d265d5f3be9e4d893533cc"
server_key_version: "encryptionkey@0"
I20260806 04:50:15.685842 28100 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:50:15.689235 28114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:15.690407 28100 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:50:15.690572 28100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/wal
uuid: "8ecc45b5ef014527915503dbba3f1232"
format_stamp: "Formatted at 2026-08-06 04:50:15 on dist-test-slave-0b58"
server_key: "5fa5afa62cedd18090e9d17735ceb920"
server_key_iv: "46bcfb7319d265d5f3be9e4d893533cc"
server_key_version: "encryptionkey@0"
I20260806 04:50:15.690793 28100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:15.708793 28100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:15.709542 28100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:15.709851 28100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:15.710754 28100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 04:50:15.712105 28100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 04:50:15.712221 28100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:15.712373 28100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 04:50:15.712461 28100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:15.743373 28100 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.195:43627
I20260806 04:50:15.743417 28226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.195:43627 every 8 connection(s)
I20260806 04:50:15.744724 28100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/data/info.pb
I20260806 04:50:15.750193 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 28100
I20260806 04:50:15.750383 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/wal/instance
I20260806 04:50:15.750944 7623 external_mini_cluster.cc:1428] Setting key 758f858c06c7fbaabac3fb5d1fe4930a
I20260806 04:50:15.757387 27968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:15.747192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.195:47637 (local address 127.7.113.254:45697)
0806 04:50:15.747435 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:15.747440 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:15.748729 (+ 1289us) server_negotiation.cc:407] Connection header received
0806 04:50:15.750867 (+ 2138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:15.750872 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:15.750941 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:15.751060 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:15.752096 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.753161 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.754945 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.755341 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.755436 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:15.756698 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:15.756702 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:15.756705 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:15.756721 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:15.756758 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:15.756769 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:15.756833 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:15.757023 (+ 190us) server_negotiation.cc:299] Negotiation successful
0806 04:50:15.757121 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 04:50:15.758396 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:15.747685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:45697 (local address 127.7.113.195:47637)
0806 04:50:15.748575 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:15.748616 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:15.750576 (+ 1960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:15.751278 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:15.751288 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:15.751398 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:15.751949 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:15.751965 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.753314 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.753319 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:15.754816 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:15.754827 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.755521 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.755525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:15.755713 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:15.756424 (+ 711us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 04:50:15.756427 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:15.756462 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 04:50:15.756539 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:15.756849 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:15.756859 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:15.756865 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 04:50:15.756996 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 04:50:15.757330 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":253,"threads_started":1}
I20260806 04:50:15.759706 28227 heartbeater.cc:347] Connected to a master server at 127.7.113.254:45697
I20260806 04:50:15.760002 28227 heartbeater.cc:464] Registering TS with master...
I20260806 04:50:15.760736 28227 heartbeater.cc:511] Master 127.7.113.254:45697 requested a full tablet report, sending...
I20260806 04:50:15.762079 27779 ts_manager.cc:194] Registered new tserver with Master: 8ecc45b5ef014527915503dbba3f1232 (127.7.113.195:43627)
I20260806 04:50:15.762823 27779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.113.195:47637
I20260806 04:50:15.766266 7623 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 04:50:15.776358 27968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:15.770323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36600 (local address 127.7.113.254:45697)
0806 04:50:15.770501 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:15.770509 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:15.770927 (+ 418us) server_negotiation.cc:407] Connection header received
0806 04:50:15.771122 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:15.771131 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:15.771202 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:15.771307 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:15.771829 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.772583 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.773947 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.774339 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.774468 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:15.775558 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:15.775563 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:15.775566 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:15.775583 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:15.775614 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:15.775625 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:15.775733 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:15.775888 (+ 155us) server_negotiation.cc:299] Negotiation successful
0806 04:50:15.775997 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 04:50:15.779779 27779 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36600:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 04:50:15.787133 27779 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 04:50:15.811542 28243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:15.801396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:43627 (local address 127.0.0.1:58152)
0806 04:50:15.802423 (+ 1027us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:15.802446 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:15.802587 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:15.803738 (+ 1151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:15.803742 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:15.803789 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:15.804198 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:15.804208 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.806696 (+ 2488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.806706 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:15.809034 (+ 2328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:15.809051 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.810524 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.810531 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:15.810736 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:15.810787 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 04:50:15.810931 (+ 144us) client_negotiation.cc:240] Negotiation successful
0806 04:50:15.811108 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":900,"mutex_wait_us":4,"spinlock_wait_cycles":1280,"thread_start_us":865,"threads_started":1}
I20260806 04:50:15.812395 28239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:15.799177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43487 (local address 127.0.0.1:39156)
0806 04:50:15.800056 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:15.800113 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:15.800336 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:15.804867 (+ 4531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:15.804871 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:15.804895 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:15.805204 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:15.805214 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.806548 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.806559 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:15.809729 (+ 3170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:15.809744 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.811600 (+ 1856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.811606 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:15.811786 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:15.811823 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 04:50:15.811883 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 04:50:15.812005 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"mutex_wait_us":280,"thread_start_us":387,"threads_started":1}
I20260806 04:50:15.812568 28240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:15.799301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:39343 (local address 127.0.0.1:34960)
0806 04:50:15.802206 (+ 2905us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:15.802233 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:15.802402 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:15.803619 (+ 1217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:15.803630 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:15.803670 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:15.804508 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:15.804517 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.806433 (+ 1916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.806441 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:15.809729 (+ 3288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:15.809744 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.811721 (+ 1977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.811727 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:15.811875 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:15.811907 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 04:50:15.811987 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 04:50:15.812120 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2701,"mutex_wait_us":529,"spinlock_wait_cycles":2816,"thread_start_us":2553,"threads_started":1}
I20260806 04:50:15.812950 28244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:15.801969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58152 (local address 127.7.113.195:43627)
0806 04:50:15.803148 (+ 1179us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:15.803156 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:15.803187 (+ 31us) server_negotiation.cc:407] Connection header received
0806 04:50:15.803279 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:15.803289 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:15.803512 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:15.804716 (+ 1204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:15.804991 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.806515 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.809236 (+ 2721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.810329 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.810473 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:15.810751 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:15.810984 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 04:50:15.812198 (+ 1214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1029,"thread_start_us":893,"threads_started":1}
I20260806 04:50:15.813136 28242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:15.799743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34960 (local address 127.7.113.194:39343)
0806 04:50:15.801689 (+ 1946us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:15.801701 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:15.802555 (+ 854us) server_negotiation.cc:407] Connection header received
0806 04:50:15.802676 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:15.802686 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:15.802978 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:15.803190 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:15.804654 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.806286 (+ 1632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.809971 (+ 3685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.811180 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.811304 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:15.811575 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:15.812393 (+ 818us) server_negotiation.cc:299] Negotiation successful
0806 04:50:15.812587 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1734,"thread_start_us":1584,"threads_started":1}
I20260806 04:50:15.813784 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:15.799349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39156 (local address 127.7.113.193:43487)
0806 04:50:15.804447 (+ 5098us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:15.804452 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:15.804474 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:50:15.804541 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:15.804545 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:15.804679 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:15.804857 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:15.805382 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.806395 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.809964 (+ 3569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:15.811377 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:15.812939 (+ 1562us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:15.813206 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:15.813288 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 04:50:15.813444 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4938,"thread_start_us":4817,"threads_started":1}
I20260806 04:50:15.816262 28032 tablet_service.cc:1467] Processing CreateTablet for tablet 6cf00caa3d4746ef820b9dbb7f434946 (DEFAULT_TABLE table=test-table [id=e4710ecc86d540349b93ff614e3f30cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:15.816524 28162 tablet_service.cc:1467] Processing CreateTablet for tablet 6cf00caa3d4746ef820b9dbb7f434946 (DEFAULT_TABLE table=test-table [id=e4710ecc86d540349b93ff614e3f30cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:15.817047 27901 tablet_service.cc:1467] Processing CreateTablet for tablet 6cf00caa3d4746ef820b9dbb7f434946 (DEFAULT_TABLE table=test-table [id=e4710ecc86d540349b93ff614e3f30cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 04:50:15.817725 28032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cf00caa3d4746ef820b9dbb7f434946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:15.817955 28162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cf00caa3d4746ef820b9dbb7f434946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:15.818305 27901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cf00caa3d4746ef820b9dbb7f434946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:15.828563 28245 tablet_bootstrap.cc:492] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74: Bootstrap starting.
I20260806 04:50:15.832167 28247 tablet_bootstrap.cc:492] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232: Bootstrap starting.
I20260806 04:50:15.832818 28245 tablet_bootstrap.cc:654] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:15.832952 28246 tablet_bootstrap.cc:492] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a: Bootstrap starting.
I20260806 04:50:15.834093 28245 log.cc:824] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:15.836589 28246 tablet_bootstrap.cc:654] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:15.836817 28245 tablet_bootstrap.cc:492] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74: No bootstrap required, opened a new log
I20260806 04:50:15.837100 28245 ts_tablet_manager.cc:1397] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.005s
I20260806 04:50:15.837756 28246 log.cc:824] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:15.838229 28247 tablet_bootstrap.cc:654] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:15.839715 28247 log.cc:824] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:15.842532 28247 tablet_bootstrap.cc:492] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232: No bootstrap required, opened a new log
I20260806 04:50:15.842803 28247 ts_tablet_manager.cc:1397] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.002s
I20260806 04:50:15.843025 28246 tablet_bootstrap.cc:492] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a: No bootstrap required, opened a new log
I20260806 04:50:15.843279 28246 ts_tablet_manager.cc:1397] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260806 04:50:15.846712 28245 raft_consensus.cc:348] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40184763d40c4950859a6f89450fee3a" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43487 } } peers { permanent_uuid: "356067eceeaa4bd19db66d1f1c4acb74" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 39343 } } peers { permanent_uuid: "8ecc45b5ef014527915503dbba3f1232" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43627 } }
I20260806 04:50:15.847164 28245 raft_consensus.cc:374] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:15.847276 28245 raft_consensus.cc:729] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356067eceeaa4bd19db66d1f1c4acb74, State: Initialized, Role: FOLLOWER
I20260806 04:50:15.847880 28245 consensus_queue.cc:260] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40184763d40c4950859a6f89450fee3a" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43487 } } peers { permanent_uuid: "356067eceeaa4bd19db66d1f1c4acb74" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 39343 } } peers { permanent_uuid: "8ecc45b5ef014527915503dbba3f1232" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43627 } }
I20260806 04:50:15.849710 28097 heartbeater.cc:503] Master 127.7.113.254:45697 was elected leader, sending a full tablet report...
I20260806 04:50:15.850369 28245 ts_tablet_manager.cc:1428] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74: Time spent starting tablet: real 0.013s user 0.012s sys 0.001s
I20260806 04:50:15.851112 28247 raft_consensus.cc:348] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40184763d40c4950859a6f89450fee3a" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43487 } } peers { permanent_uuid: "356067eceeaa4bd19db66d1f1c4acb74" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 39343 } } peers { permanent_uuid: "8ecc45b5ef014527915503dbba3f1232" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43627 } }
I20260806 04:50:15.851537 28247 raft_consensus.cc:374] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:15.851657 28247 raft_consensus.cc:729] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ecc45b5ef014527915503dbba3f1232, State: Initialized, Role: FOLLOWER
I20260806 04:50:15.852200 28247 consensus_queue.cc:260] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40184763d40c4950859a6f89450fee3a" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43487 } } peers { permanent_uuid: "356067eceeaa4bd19db66d1f1c4acb74" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 39343 } } peers { permanent_uuid: "8ecc45b5ef014527915503dbba3f1232" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43627 } }
I20260806 04:50:15.853277 28227 heartbeater.cc:503] Master 127.7.113.254:45697 was elected leader, sending a full tablet report...
I20260806 04:50:15.853904 28247 ts_tablet_manager.cc:1428] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232: Time spent starting tablet: real 0.011s user 0.007s sys 0.005s
I20260806 04:50:15.853639 28246 raft_consensus.cc:348] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40184763d40c4950859a6f89450fee3a" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43487 } } peers { permanent_uuid: "356067eceeaa4bd19db66d1f1c4acb74" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 39343 } } peers { permanent_uuid: "8ecc45b5ef014527915503dbba3f1232" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43627 } }
I20260806 04:50:15.854040 28246 raft_consensus.cc:374] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:15.854121 28246 raft_consensus.cc:729] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40184763d40c4950859a6f89450fee3a, State: Initialized, Role: FOLLOWER
I20260806 04:50:15.854636 28246 consensus_queue.cc:260] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40184763d40c4950859a6f89450fee3a" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43487 } } peers { permanent_uuid: "356067eceeaa4bd19db66d1f1c4acb74" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 39343 } } peers { permanent_uuid: "8ecc45b5ef014527915503dbba3f1232" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43627 } }
I20260806 04:50:15.855857 27966 heartbeater.cc:503] Master 127.7.113.254:45697 was elected leader, sending a full tablet report...
I20260806 04:50:15.856348 28246 ts_tablet_manager.cc:1428] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a: Time spent starting tablet: real 0.013s user 0.009s sys 0.006s
W20260806 04:50:15.857975 27967 tablet.cc:2369] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:50:15.996347 28228 tablet.cc:2369] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 04:50:16.050606 28098 tablet.cc:2369] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:50:16.147565 28253 raft_consensus.cc:482] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 04:50:16.147887 28253 raft_consensus.cc:504] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40184763d40c4950859a6f89450fee3a" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43487 } } peers { permanent_uuid: "356067eceeaa4bd19db66d1f1c4acb74" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 39343 } } peers { permanent_uuid: "8ecc45b5ef014527915503dbba3f1232" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43627 } }
I20260806 04:50:16.149614 28253 leader_election.cc:288] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 356067eceeaa4bd19db66d1f1c4acb74 (127.7.113.194:39343), 8ecc45b5ef014527915503dbba3f1232 (127.7.113.195:43627)
I20260806 04:50:16.158771 28244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.150181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:48851 (local address 127.7.113.195:43627)
0806 04:50:16.150384 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:16.150390 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:16.151205 (+ 815us) server_negotiation.cc:407] Connection header received
0806 04:50:16.151308 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:16.151314 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:16.151393 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:16.151492 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:16.152341 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.153368 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.156483 (+ 3115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.157740 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.157895 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:16.157965 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:16.158401 (+ 436us) server_negotiation.cc:299] Negotiation successful
0806 04:50:16.158521 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 04:50:16.158787 28242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.150181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.113.193:48513 (local address 127.7.113.194:39343)
0806 04:50:16.150387 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:16.150392 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:16.151127 (+ 735us) server_negotiation.cc:407] Connection header received
0806 04:50:16.151322 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:16.151326 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:16.151392 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:16.151492 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 04:50:16.152204 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.153351 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.156472 (+ 3121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.157706 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.157895 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:16.157965 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:16.158391 (+ 426us) server_negotiation.cc:299] Negotiation successful
0806 04:50:16.158515 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 04:50:16.158973 28254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.150005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.195:43627 (local address 127.7.113.193:48851)
0806 04:50:16.151094 (+ 1089us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:16.151108 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:16.151199 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:16.151524 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:16.151529 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:16.151554 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:16.152132 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:16.152144 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.153514 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.153518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:16.156225 (+ 2707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:16.156242 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.157964 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.157972 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:16.158246 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:16.158270 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 04:50:16.158348 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 04:50:16.158550 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":976,"mutex_wait_us":315,"thread_start_us":570,"threads_started":1}
I20260806 04:50:16.159008 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.149926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.194:39343 (local address 127.7.113.193:48513)
0806 04:50:16.150996 (+ 1070us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:16.151018 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:16.151187 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:16.151524 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:16.151529 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:16.151616 (+ 87us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 04:50:16.152044 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:16.152065 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.153511 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.153516 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:16.156225 (+ 2709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:16.156242 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.157983 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.157990 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:16.158210 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:16.158248 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 04:50:16.158348 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 04:50:16.158550 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":913,"mutex_wait_us":263,"spinlock_wait_cycles":21760,"thread_start_us":648,"threads_started":1}
I20260806 04:50:16.160286 28052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cf00caa3d4746ef820b9dbb7f434946" candidate_uuid: "40184763d40c4950859a6f89450fee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356067eceeaa4bd19db66d1f1c4acb74" is_pre_election: true
I20260806 04:50:16.160315 28182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cf00caa3d4746ef820b9dbb7f434946" candidate_uuid: "40184763d40c4950859a6f89450fee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ecc45b5ef014527915503dbba3f1232" is_pre_election: true
I20260806 04:50:16.160920 28052 raft_consensus.cc:2454] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40184763d40c4950859a6f89450fee3a in term 0.
I20260806 04:50:16.160920 28182 raft_consensus.cc:2454] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40184763d40c4950859a6f89450fee3a in term 0.
I20260806 04:50:16.161671 27854 leader_election.cc:302] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 356067eceeaa4bd19db66d1f1c4acb74, 40184763d40c4950859a6f89450fee3a, 8ecc45b5ef014527915503dbba3f1232; no voters:
I20260806 04:50:16.162189 28253 raft_consensus.cc:2781] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 04:50:16.162370 28253 raft_consensus.cc:482] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 04:50:16.162499 28253 raft_consensus.cc:3037] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:16.164829 28253 raft_consensus.cc:504] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40184763d40c4950859a6f89450fee3a" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43487 } } peers { permanent_uuid: "356067eceeaa4bd19db66d1f1c4acb74" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 39343 } } peers { permanent_uuid: "8ecc45b5ef014527915503dbba3f1232" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43627 } }
I20260806 04:50:16.165501 28253 leader_election.cc:288] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [CANDIDATE]: Term 1 election: Requested vote from peers 356067eceeaa4bd19db66d1f1c4acb74 (127.7.113.194:39343), 8ecc45b5ef014527915503dbba3f1232 (127.7.113.195:43627)
I20260806 04:50:16.166002 28182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cf00caa3d4746ef820b9dbb7f434946" candidate_uuid: "40184763d40c4950859a6f89450fee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ecc45b5ef014527915503dbba3f1232"
I20260806 04:50:16.166002 28052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cf00caa3d4746ef820b9dbb7f434946" candidate_uuid: "40184763d40c4950859a6f89450fee3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356067eceeaa4bd19db66d1f1c4acb74"
I20260806 04:50:16.166239 28182 raft_consensus.cc:3037] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:16.166224 28052 raft_consensus.cc:3037] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:16.169524 28052 raft_consensus.cc:2454] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40184763d40c4950859a6f89450fee3a in term 1.
I20260806 04:50:16.169524 28182 raft_consensus.cc:2454] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40184763d40c4950859a6f89450fee3a in term 1.
I20260806 04:50:16.169950 27854 leader_election.cc:302] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40184763d40c4950859a6f89450fee3a, 8ecc45b5ef014527915503dbba3f1232; no voters:
I20260806 04:50:16.170262 28253 raft_consensus.cc:2781] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:16.170696 28253 raft_consensus.cc:686] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [term 1 LEADER]: Becoming Leader. State: Replica: 40184763d40c4950859a6f89450fee3a, State: Running, Role: LEADER
I20260806 04:50:16.171159 28253 consensus_queue.cc:237] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40184763d40c4950859a6f89450fee3a" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43487 } } peers { permanent_uuid: "356067eceeaa4bd19db66d1f1c4acb74" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 39343 } } peers { permanent_uuid: "8ecc45b5ef014527915503dbba3f1232" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43627 } }
I20260806 04:50:16.175901 27778 catalog_manager.cc:5495] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 40184763d40c4950859a6f89450fee3a (127.7.113.193). New cstate: current_term: 1 leader_uuid: "40184763d40c4950859a6f89450fee3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40184763d40c4950859a6f89450fee3a" member_type: VOTER last_known_addr { host: "127.7.113.193" port: 43487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "356067eceeaa4bd19db66d1f1c4acb74" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 39343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ecc45b5ef014527915503dbba3f1232" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43627 } health_report { overall_health: UNKNOWN } } }
I20260806 04:50:16.263284 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.257882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39166 (local address 127.7.113.193:43487)
0806 04:50:16.258146 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:16.258150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:16.258169 (+ 19us) server_negotiation.cc:407] Connection header received
0806 04:50:16.258338 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:16.258342 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:16.258475 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:16.258595 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:50:16.258957 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.259677 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.261173 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.261594 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.261729 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:16.262234 (+ 505us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:50:16.262706 (+ 472us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:50:16.262889 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:16.262942 (+ 53us) server_negotiation.cc:299] Negotiation successful
0806 04:50:16.263020 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260806 04:50:16.271349 28052 raft_consensus.cc:1261] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74 [term 1 FOLLOWER]: Refusing update from remote peer 40184763d40c4950859a6f89450fee3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:50:16.271351 28182 raft_consensus.cc:1261] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232 [term 1 FOLLOWER]: Refusing update from remote peer 40184763d40c4950859a6f89450fee3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:50:16.272286 28256 consensus_queue.cc:1035] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "356067eceeaa4bd19db66d1f1c4acb74" member_type: VOTER last_known_addr { host: "127.7.113.194" port: 39343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:50:16.272616 28253 consensus_queue.cc:1035] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ecc45b5ef014527915503dbba3f1232" member_type: VOTER last_known_addr { host: "127.7.113.195" port: 43627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:50:16.283555 28259 mvcc.cc:205] Tried to move back new op lower bound from 7315422479438213120 to 7315422479040745472. Current Snapshot: MvccSnapshot[applied={T|T < 7315422479438213120}]
I20260806 04:50:16.284739 28261 mvcc.cc:205] Tried to move back new op lower bound from 7315422479438213120 to 7315422479040745472. Current Snapshot: MvccSnapshot[applied={T|T < 7315422479438213120}]
I20260806 04:50:16.284945 28260 mvcc.cc:205] Tried to move back new op lower bound from 7315422479438213120 to 7315422479040745472. Current Snapshot: MvccSnapshot[applied={T|T < 7315422479438213120}]
I20260806 04:50:16.300936 27779 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:50:16.301229 27779 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 04:50:16.304699 27779 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cfa951d067824e3ebe63f1b73bce4905: Sending DeleteTablet for 3 replicas of tablet 6cf00caa3d4746ef820b9dbb7f434946
I20260806 04:50:16.305871 28162 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cf00caa3d4746ef820b9dbb7f434946 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:16 UTC) from {username='slave'} at 127.0.0.1:58152
I20260806 04:50:16.306046 28032 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cf00caa3d4746ef820b9dbb7f434946 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:16 UTC) from {username='slave'} at 127.0.0.1:34960
I20260806 04:50:16.306875 27901 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cf00caa3d4746ef820b9dbb7f434946 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 04:50:16 UTC) from {username='slave'} at 127.0.0.1:39156
I20260806 04:50:16.307003 28269 tablet_replica.cc:330] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74: stopping tablet replica
I20260806 04:50:16.307404 28269 raft_consensus.cc:2229] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:50:16.307946 28269 raft_consensus.cc:2258] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:16.309003 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 27838
I20260806 04:50:16.319476 28269 ts_tablet_manager.cc:1905] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:16.331710 28270 tablet_replica.cc:330] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a: stopping tablet replica
I20260806 04:50:16.332350 28270 raft_consensus.cc:2229] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [term 1 LEADER]: Raft consensus shutting down.
I20260806 04:50:16.333123 28270 raft_consensus.cc:2258] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:16.333652 28268 tablet_replica.cc:330] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232: stopping tablet replica
I20260806 04:50:16.334296 28268 raft_consensus.cc:2229] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 04:50:16.337066 28269 ts_tablet_manager.cc:1918] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:50:16.337170 28270 ts_tablet_manager.cc:1905] T 6cf00caa3d4746ef820b9dbb7f434946 P 40184763d40c4950859a6f89450fee3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:16.337284 28269 log.cc:1196] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-1/wal/wals/6cf00caa3d4746ef820b9dbb7f434946
I20260806 04:50:16.337455 28268 raft_consensus.cc:2258] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 04:50:16.337909 28269 ts_tablet_manager.cc:1939] T 6cf00caa3d4746ef820b9dbb7f434946 P 356067eceeaa4bd19db66d1f1c4acb74: Deleting consensus metadata
I20260806 04:50:16.339783 27766 catalog_manager.cc:4841] TS 356067eceeaa4bd19db66d1f1c4acb74 (127.7.113.194:39343): tablet 6cf00caa3d4746ef820b9dbb7f434946 (table test-table [id=e4710ecc86d540349b93ff614e3f30cf]) successfully deleted
I20260806 04:50:16.341167 28268 ts_tablet_manager.cc:1905] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 04:50:16.342602 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.311891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39172 (local address 127.7.113.193:43487)
0806 04:50:16.312382 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:16.312391 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:16.329438 (+ 17047us) server_negotiation.cc:407] Connection header received
0806 04:50:16.329952 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:16.329961 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:16.330079 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:16.330179 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:16.331019 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.332383 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.334128 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.334778 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.334866 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:16.340524 (+ 5658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:16.340536 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:16.340555 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:16.341320 (+ 765us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:16.341401 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:16.341425 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:16.341522 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:16.342129 (+ 607us) server_negotiation.cc:299] Negotiation successful
0806 04:50:16.342234 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311}
I20260806 04:50:16.343282 27961 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:16.349381 28268 ts_tablet_manager.cc:1918] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 04:50:16.349561 28268 log.cc:1196] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232: Deleting WAL directory at /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785991498713577-7623-0/minicluster-data/ts-2/wal/wals/6cf00caa3d4746ef820b9dbb7f434946
I20260806 04:50:16.350011 28268 ts_tablet_manager.cc:1939] T 6cf00caa3d4746ef820b9dbb7f434946 P 8ecc45b5ef014527915503dbba3f1232: Deleting consensus metadata
I20260806 04:50:16.351536 27764 catalog_manager.cc:4841] TS 8ecc45b5ef014527915503dbba3f1232 (127.7.113.195:43627): tablet 6cf00caa3d4746ef820b9dbb7f434946 (table test-table [id=e4710ecc86d540349b93ff614e3f30cf]) successfully deleted
I20260806 04:50:16.440361 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 27838
I20260806 04:50:16.460693 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 27970
W20260806 04:50:16.460767 27764 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.113.193:43487 (error 108)
I20260806 04:50:16.462857 28274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.462025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43487 (local address 127.0.0.1:39186)
0806 04:50:16.462472 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:16.462609 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":219,"threads_started":1}
W20260806 04:50:16.463088 27764 catalog_manager.cc:4584] TS 40184763d40c4950859a6f89450fee3a (127.7.113.193:43487): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6cf00caa3d4746ef820b9dbb7f434946: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43487: connect: Connection refused (error 111)
I20260806 04:50:16.467936 28242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.461762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34970 (local address 127.7.113.194:39343)
0806 04:50:16.461952 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:16.461958 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:16.461978 (+ 20us) server_negotiation.cc:407] Connection header received
0806 04:50:16.462045 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:16.462050 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:16.462157 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:16.462288 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:16.462749 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.463588 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.465111 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.465512 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.465602 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:16.466673 (+ 1071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:16.466680 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:16.466693 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:16.467239 (+ 546us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:16.467284 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:16.467302 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:16.467407 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:16.467502 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 04:50:16.467583 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 04:50:16.468624 28092 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:16.516788 28274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.516331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43487 (local address 127.0.0.1:39190)
0806 04:50:16.516537 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:16.516622 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 04:50:16.517802 28274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.517433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43487 (local address 127.0.0.1:39200)
0806 04:50:16.517601 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:16.517666 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 04:50:16.557768 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 27970
I20260806 04:50:16.576601 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 28100
I20260806 04:50:16.578217 28274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.577705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43487 (local address 127.0.0.1:39206)
0806 04:50:16.577881 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:16.578011 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 04:50:16.579212 28274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.578864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43487 (local address 127.0.0.1:39218)
0806 04:50:16.578989 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:16.579057 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 04:50:16.583446 28244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.577407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58160 (local address 127.7.113.195:43627)
0806 04:50:16.577618 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:16.577625 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:16.577646 (+ 21us) server_negotiation.cc:407] Connection header received
0806 04:50:16.577721 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:16.577726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:16.577836 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:16.577942 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:16.578514 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.579462 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.580752 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:16.581142 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:16.581230 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:16.582128 (+ 898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:16.582136 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:16.582150 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:16.582740 (+ 590us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:16.582785 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:16.582805 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:16.582954 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:16.583035 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 04:50:16.583123 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 04:50:16.584123 28222 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:16.659863 28274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.659391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43487 (local address 127.0.0.1:39220)
0806 04:50:16.659611 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:16.659701 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 04:50:16.660986 28274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:16.660573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.193:43487 (local address 127.0.0.1:39236)
0806 04:50:16.660790 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:16.660856 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.193:43487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260806 04:50:16.671273 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 28100
I20260806 04:50:16.689054 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 27748
I20260806 04:50:16.690112 27809 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:16.798703 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 27748
2026-08-06T04:50:16Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2997 ms)
[----------] 6 tests from EncryptionPolicyTest (22233 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:16 dist-test-slave-0b58 krb5kdc[28280](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:16 dist-test-slave-0b58 krb5kdc[28280](info): set up 2 sockets
Aug 06 04:50:16 dist-test-slave-0b58 krb5kdc[28280](info): commencing operation
krb5kdc: starting...
W20260806 04:50:17.926900 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.006s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:18 dist-test-slave-0b58 krb5kdc[28280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 04:50:18.215430 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46451
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46451
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:18.548720 28293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:18.549049 28293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:18.549221 28293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:18.556412 28293 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:18.556548 28293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:18.556653 28293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:18.556747 28293 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:18.556819 28293 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:18.566525 28293 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46451
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:18.567793 28293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:18.569120 28293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:18.581185 28299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:18.581282 28298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:18.581305 28301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:18.582168 28293 server_base.cc:1034] running on GCE node
I20260806 04:50:18.582895 28293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:18.584376 28293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:18.585606 28293 hybrid_clock.cc:648] HybridClock initialized: now 1785991818585551 us; error 46 us; skew 500 ppm
I20260806 04:50:18.585976 28293 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:18 dist-test-slave-0b58 krb5kdc[28280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991818, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:18.589074 28293 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 04:50:18.590602 28293 webserver.cc:460] Webserver started at http://127.0.0.1:39531/ using document root <none> and password file <none>
I20260806 04:50:18.591310 28293 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:18.591454 28293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:18.591758 28293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:18.594880 28293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "b9c2eee0db1645aa9b0a57207e2d3c8b"
format_stamp: "Formatted at 2026-08-06 04:50:18 on dist-test-slave-0b58"
server_key: "22d8762568d215279a07a5b31118dbf9"
server_key_iv: "d25173ceda28519574d1645ba9748dd2"
server_key_version: "encryptionkey@0"
I20260806 04:50:18.595640 28293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "b9c2eee0db1645aa9b0a57207e2d3c8b"
format_stamp: "Formatted at 2026-08-06 04:50:18 on dist-test-slave-0b58"
server_key: "22d8762568d215279a07a5b31118dbf9"
server_key_iv: "d25173ceda28519574d1645ba9748dd2"
server_key_version: "encryptionkey@0"
I20260806 04:50:18.600821 28293 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260806 04:50:18.604071 28308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:18.605404 28293 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:50:18.605593 28293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "b9c2eee0db1645aa9b0a57207e2d3c8b"
format_stamp: "Formatted at 2026-08-06 04:50:18 on dist-test-slave-0b58"
server_key: "22d8762568d215279a07a5b31118dbf9"
server_key_iv: "d25173ceda28519574d1645ba9748dd2"
server_key_version: "encryptionkey@0"
I20260806 04:50:18.605801 28293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:18.619743 28293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:18.623512 28293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:18.623801 28293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:18.642220 28293 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46451
I20260806 04:50:18.642256 28360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46451 every 8 connection(s)
I20260806 04:50:18.643667 28293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:18.646736 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 28293
I20260806 04:50:18.646965 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:18.647775 28361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:18.647835 7623 external_mini_cluster.cc:1428] Setting key 08f25c0f42f83f0db02d8f993b32f1d3
I20260806 04:50:18.662266 28361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b: Bootstrap starting.
Aug 06 04:50:18 dist-test-slave-0b58 krb5kdc[28280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 04:50:18.666107 28361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:18.667440 28361 log.cc:824] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:18.670784 28361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b: No bootstrap required, opened a new log
I20260806 04:50:18.672505 28364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:18.649783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38657 (local address 127.0.0.1:46451)
0806 04:50:18.650552 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:18.650565 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:18.650606 (+ 41us) server_negotiation.cc:407] Connection header received
0806 04:50:18.652499 (+ 1893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:18.652519 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:18.652889 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:18.653196 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:18.655018 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:18.656344 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:18.658129 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:18.658827 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:18.658961 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:18.663877 (+ 4916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:18.663888 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:18.663905 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:18.663957 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:18.667820 (+ 3863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:18.668848 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:18.668866 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:18.668874 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:18.669061 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:18.669500 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:18.669505 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:18.669508 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:18.670189 (+ 681us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:18.670484 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:18.670848 (+ 364us) server_negotiation.cc:299] Negotiation successful
0806 04:50:18.671185 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":340,"threads_started":1}
I20260806 04:50:18.676488 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:18.679505 28361 raft_consensus.cc:348] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9c2eee0db1645aa9b0a57207e2d3c8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46451 } }
I20260806 04:50:18.679914 28361 raft_consensus.cc:374] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:18.680022 28361 raft_consensus.cc:729] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c2eee0db1645aa9b0a57207e2d3c8b, State: Initialized, Role: FOLLOWER
I20260806 04:50:18.680647 28361 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9c2eee0db1645aa9b0a57207e2d3c8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46451 } }
I20260806 04:50:18.680894 28361 raft_consensus.cc:388] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:18.681033 28361 raft_consensus.cc:482] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:18.681214 28361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:18.683629 28361 raft_consensus.cc:504] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9c2eee0db1645aa9b0a57207e2d3c8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46451 } }
I20260806 04:50:18.684109 28361 leader_election.cc:302] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b9c2eee0db1645aa9b0a57207e2d3c8b; no voters:
I20260806 04:50:18.684795 28361 leader_election.cc:288] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:18.684926 28371 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:18.687297 28361 sys_catalog.cc:564] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:18.688551 28371 raft_consensus.cc:686] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [term 1 LEADER]: Becoming Leader. State: Replica: b9c2eee0db1645aa9b0a57207e2d3c8b, State: Running, Role: LEADER
I20260806 04:50:18.689244 28371 consensus_queue.cc:237] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9c2eee0db1645aa9b0a57207e2d3c8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46451 } }
I20260806 04:50:18.692534 28373 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9c2eee0db1645aa9b0a57207e2d3c8b. Latest consensus state: current_term: 1 leader_uuid: "b9c2eee0db1645aa9b0a57207e2d3c8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9c2eee0db1645aa9b0a57207e2d3c8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46451 } } }
I20260806 04:50:18.693003 28373 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:18.693676 28372 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b9c2eee0db1645aa9b0a57207e2d3c8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9c2eee0db1645aa9b0a57207e2d3c8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46451 } } }
I20260806 04:50:18.694036 28372 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:18.699369 28364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:18.681659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38725 (local address 127.0.0.1:46451)
0806 04:50:18.681840 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:18.681848 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:18.682217 (+ 369us) server_negotiation.cc:407] Connection header received
0806 04:50:18.682412 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:18.682420 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:18.682494 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:18.682604 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:18.684058 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:18.684989 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:18.686613 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:18.687132 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:18.687280 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:18.690116 (+ 2836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:18.690121 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:18.690125 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:18.690158 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:18.693979 (+ 3821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:18.695265 (+ 1286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:18.695272 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:18.695279 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:18.695450 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:18.696177 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:18.696185 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:18.696190 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:18.696785 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:18.698391 (+ 1606us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:18.698617 (+ 226us) server_negotiation.cc:299] Negotiation successful
0806 04:50:18.698854 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 04:50:18.701328 28377 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:18.706429 28377 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:18.715258 28377 catalog_manager.cc:1347] Generated new cluster ID: 3eff797768844ea2b88c8604efe9e620
I20260806 04:50:18.715359 28377 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:18.750192 28377 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:18.751554 28377 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:18.761067 28377 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b9c2eee0db1645aa9b0a57207e2d3c8b: Generated new TSK 0
I20260806 04:50:18.761859 28377 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:18.773236 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 28293
I20260806 04:50:18.774603 28356 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:18.866909 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 28293
W20260806 04:50:18.886787 28278 connection.cc:535] client connection to 127.0.0.1:46451 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46451): Connection reset by peer (error 104)
2026-08-06T04:50:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2063 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:18 dist-test-slave-0b58 krb5kdc[28394](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:18 dist-test-slave-0b58 krb5kdc[28394](info): set up 2 sockets
Aug 06 04:50:18 dist-test-slave-0b58 krb5kdc[28394](info): commencing operation
krb5kdc: starting...
W20260806 04:50:19.998625 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:20 dist-test-slave-0b58 krb5kdc[28394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 04:50:20.275723 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36351
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36351
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:20.602850 28407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:20.603127 28407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:20.603313 28407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:20.610356 28407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:20.610481 28407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:20.610580 28407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:20.610692 28407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:20.610780 28407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:20.619979 28407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36351
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:20.621340 28407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:20.622677 28407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:20.634195 28412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:20.634114 28413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:20.634160 28415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:20.634954 28407 server_base.cc:1034] running on GCE node
I20260806 04:50:20.635639 28407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:20.636971 28407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:20.638217 28407 hybrid_clock.cc:648] HybridClock initialized: now 1785991820638177 us; error 38 us; skew 500 ppm
I20260806 04:50:20.638546 28407 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:20 dist-test-slave-0b58 krb5kdc[28394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991820, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:20.641613 28407 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 04:50:20.642961 28407 webserver.cc:460] Webserver started at http://127.0.0.1:45489/ using document root <none> and password file <none>
I20260806 04:50:20.643591 28407 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:20.643739 28407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:20.644032 28407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:20.646935 28407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "cb4e30850d454f1ebd666af68829f283"
format_stamp: "Formatted at 2026-08-06 04:50:20 on dist-test-slave-0b58"
server_key: "b208ad2ad83c9901f7bc9cacb59c48cd"
server_key_iv: "1ec045643a4cbd7faccf360b5cb9c4c9"
server_key_version: "encryptionkey@0"
I20260806 04:50:20.647715 28407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "cb4e30850d454f1ebd666af68829f283"
format_stamp: "Formatted at 2026-08-06 04:50:20 on dist-test-slave-0b58"
server_key: "b208ad2ad83c9901f7bc9cacb59c48cd"
server_key_iv: "1ec045643a4cbd7faccf360b5cb9c4c9"
server_key_version: "encryptionkey@0"
I20260806 04:50:20.652634 28407 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 04:50:20.655767 28422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:20.656971 28407 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 04:50:20.657142 28407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "cb4e30850d454f1ebd666af68829f283"
format_stamp: "Formatted at 2026-08-06 04:50:20 on dist-test-slave-0b58"
server_key: "b208ad2ad83c9901f7bc9cacb59c48cd"
server_key_iv: "1ec045643a4cbd7faccf360b5cb9c4c9"
server_key_version: "encryptionkey@0"
I20260806 04:50:20.657326 28407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:20.676908 28407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:20.680588 28407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:20.680886 28407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:20.699133 28407 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36351
I20260806 04:50:20.699172 28473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36351 every 8 connection(s)
I20260806 04:50:20.700546 28407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:20.701017 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 28407
I20260806 04:50:20.701231 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:20.701829 7623 external_mini_cluster.cc:1428] Setting key 98228700f216b32bdd96b6869fb662e7
I20260806 04:50:20.704881 28474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:20.715426 28478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:20.703626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38339 (local address 127.0.0.1:36351)
0806 04:50:20.704440 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:20.704452 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:20.704491 (+ 39us) server_negotiation.cc:407] Connection header received
0806 04:50:20.706296 (+ 1805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:20.706317 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:20.706688 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:20.707001 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:20.707596 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:20.708998 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:20.710874 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:20.711502 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:20.711633 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:20.713004 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:20.713013 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:20.713025 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:20.713543 (+ 518us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:20.713618 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:20.713646 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:20.713780 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:20.714303 (+ 523us) server_negotiation.cc:299] Negotiation successful
0806 04:50:20.714471 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":364,"threads_started":1}
I20260806 04:50:20.716964 28474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283: Bootstrap starting.
I20260806 04:50:20.719147 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:20.720208 28474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:20.721426 28474 log.cc:824] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:20.724167 28474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283: No bootstrap required, opened a new log
I20260806 04:50:20.731393 28478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:20.724569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40831 (local address 127.0.0.1:36351)
0806 04:50:20.724798 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:20.724812 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:20.725172 (+ 360us) server_negotiation.cc:407] Connection header received
0806 04:50:20.725375 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:20.725378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:20.725434 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:20.725507 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:20.726150 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:20.726936 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:20.728820 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:20.729279 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:20.729372 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:20.730614 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:20.730622 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:20.730625 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:20.730640 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:20.730679 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:20.730693 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:20.730778 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:20.730987 (+ 209us) server_negotiation.cc:299] Negotiation successful
0806 04:50:20.731027 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 04:50:20.734169 28474 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4e30850d454f1ebd666af68829f283" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36351 } }
I20260806 04:50:20.734561 28474 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:20.734675 28474 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb4e30850d454f1ebd666af68829f283, State: Initialized, Role: FOLLOWER
I20260806 04:50:20.735241 28474 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4e30850d454f1ebd666af68829f283" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36351 } }
I20260806 04:50:20.735478 28474 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:20.735618 28474 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:20.735796 28474 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:20.738504 28474 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4e30850d454f1ebd666af68829f283" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36351 } }
I20260806 04:50:20.738989 28474 leader_election.cc:302] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb4e30850d454f1ebd666af68829f283; no voters:
I20260806 04:50:20.739585 28474 leader_election.cc:288] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:20.739711 28485 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:20.740412 28485 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [term 1 LEADER]: Becoming Leader. State: Replica: cb4e30850d454f1ebd666af68829f283, State: Running, Role: LEADER
I20260806 04:50:20.740914 28485 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4e30850d454f1ebd666af68829f283" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36351 } }
I20260806 04:50:20.741643 28474 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:20.743772 28486 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb4e30850d454f1ebd666af68829f283" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4e30850d454f1ebd666af68829f283" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36351 } } }
I20260806 04:50:20.744246 28486 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:20.744073 28487 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb4e30850d454f1ebd666af68829f283. Latest consensus state: current_term: 1 leader_uuid: "cb4e30850d454f1ebd666af68829f283" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4e30850d454f1ebd666af68829f283" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36351 } } }
I20260806 04:50:20.744403 28487 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:20.746706 28492 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:20.751868 28492 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:20.760599 28492 catalog_manager.cc:1347] Generated new cluster ID: e03e4b40dda347b48831fffec2f25d44
I20260806 04:50:20.760779 28492 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:20.784907 28492 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:20.786103 28492 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:20.792541 28492 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb4e30850d454f1ebd666af68829f283: Generated new TSK 0
I20260806 04:50:20.793308 28492 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:20.806387 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 28407
W20260806 04:50:20.807444 28469 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:38339
W20260806 04:50:20.808310 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 28407: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:50:20.808545 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 28407
W20260806 04:50:20.827486 28392 connection.cc:535] client connection to 127.0.0.1:36351 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36351): Connection reset by peer (error 104)
2026-08-06T04:50:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1940 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:20 dist-test-slave-0b58 krb5kdc[28506](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:20 dist-test-slave-0b58 krb5kdc[28506](info): set up 2 sockets
Aug 06 04:50:20 dist-test-slave-0b58 krb5kdc[28506](info): commencing operation
krb5kdc: starting...
W20260806 04:50:21.922479 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:22 dist-test-slave-0b58 krb5kdc[28506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 04:50:22.215937 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40965
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40965
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:22.548925 28519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:22.549170 28519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:22.549255 28519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:22.556200 28519 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:22.556354 28519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:22.556414 28519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:22.556466 28519 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:22.556509 28519 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:22.565974 28519 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40965
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:22.567077 28519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:22.568231 28519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:22.579504 28525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:22.579504 28527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:22.579540 28524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:22.580379 28519 server_base.cc:1034] running on GCE node
I20260806 04:50:22.581107 28519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:22.582372 28519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:22.583599 28519 hybrid_clock.cc:648] HybridClock initialized: now 1785991822583560 us; error 53 us; skew 500 ppm
I20260806 04:50:22.583940 28519 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:22 dist-test-slave-0b58 krb5kdc[28506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991822, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:22.590440 28519 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 04:50:22.591768 28519 webserver.cc:460] Webserver started at http://127.0.0.1:42087/ using document root <none> and password file <none>
I20260806 04:50:22.592495 28519 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:22.592639 28519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:22.592942 28519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:22.595712 28519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "c98de5f0a6f142118e01d539946946f9"
format_stamp: "Formatted at 2026-08-06 04:50:22 on dist-test-slave-0b58"
server_key: "0eb13e91444a72271b239c5f73415b7e"
server_key_iv: "0887c98b0362f7a30039a764b600f471"
server_key_version: "encryptionkey@0"
I20260806 04:50:22.596560 28519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "c98de5f0a6f142118e01d539946946f9"
format_stamp: "Formatted at 2026-08-06 04:50:22 on dist-test-slave-0b58"
server_key: "0eb13e91444a72271b239c5f73415b7e"
server_key_iv: "0887c98b0362f7a30039a764b600f471"
server_key_version: "encryptionkey@0"
I20260806 04:50:22.601428 28519 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 04:50:22.604779 28534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:22.605952 28519 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260806 04:50:22.606134 28519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "c98de5f0a6f142118e01d539946946f9"
format_stamp: "Formatted at 2026-08-06 04:50:22 on dist-test-slave-0b58"
server_key: "0eb13e91444a72271b239c5f73415b7e"
server_key_iv: "0887c98b0362f7a30039a764b600f471"
server_key_version: "encryptionkey@0"
I20260806 04:50:22.606334 28519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:22.611513 28519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:22.615137 28519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:22.615422 28519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:22.633639 28519 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40965
I20260806 04:50:22.633711 28586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40965 every 8 connection(s)
I20260806 04:50:22.634882 28519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:22.636813 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 28519
I20260806 04:50:22.636996 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:22.637436 7623 external_mini_cluster.cc:1428] Setting key 249b14bb6e60580d3109b675596b7154
I20260806 04:50:22.638717 28587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:22.645457 28590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:22.639085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44671 (local address 127.0.0.1:40965)
0806 04:50:22.639925 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:22.639939 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:22.639993 (+ 54us) server_negotiation.cc:407] Connection header received
0806 04:50:22.641868 (+ 1875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:22.641893 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:22.642310 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:22.642717 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:22.643641 (+ 924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:22.643651 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:22.643672 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:22.643688 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:22.643775 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:22.643807 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:22.644014 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:22.644135 (+ 121us) server_negotiation.cc:299] Negotiation successful
0806 04:50:22.644338 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":357,"threads_started":1}
I20260806 04:50:22.648777 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:22.652818 28587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9: Bootstrap starting.
I20260806 04:50:22.656234 28590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:22.654023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53715 (local address 127.0.0.1:40965)
0806 04:50:22.654176 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:22.654183 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:22.654504 (+ 321us) server_negotiation.cc:407] Connection header received
0806 04:50:22.654624 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:22.654630 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:22.654692 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:22.654800 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:22.655610 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:22.655618 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:22.655623 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:22.655639 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:22.655686 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:22.655705 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:22.655811 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:22.655902 (+ 91us) server_negotiation.cc:299] Negotiation successful
0806 04:50:22.655954 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 04:50:22.656376 28587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:22.657614 28587 log.cc:824] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:22.659976 28587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9: No bootstrap required, opened a new log
I20260806 04:50:22.666993 28587 raft_consensus.cc:348] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98de5f0a6f142118e01d539946946f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40965 } }
I20260806 04:50:22.667333 28587 raft_consensus.cc:374] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:22.667446 28587 raft_consensus.cc:729] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98de5f0a6f142118e01d539946946f9, State: Initialized, Role: FOLLOWER
I20260806 04:50:22.667971 28587 consensus_queue.cc:260] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98de5f0a6f142118e01d539946946f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40965 } }
I20260806 04:50:22.668210 28587 raft_consensus.cc:388] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:22.668383 28587 raft_consensus.cc:482] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:22.668582 28587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:22.670674 28587 raft_consensus.cc:504] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98de5f0a6f142118e01d539946946f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40965 } }
I20260806 04:50:22.671164 28587 leader_election.cc:302] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c98de5f0a6f142118e01d539946946f9; no voters:
I20260806 04:50:22.671772 28587 leader_election.cc:288] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:22.671895 28597 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:22.672639 28597 raft_consensus.cc:686] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [term 1 LEADER]: Becoming Leader. State: Replica: c98de5f0a6f142118e01d539946946f9, State: Running, Role: LEADER
I20260806 04:50:22.673213 28597 consensus_queue.cc:237] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98de5f0a6f142118e01d539946946f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40965 } }
I20260806 04:50:22.673889 28587 sys_catalog.cc:564] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:22.675734 28598 sys_catalog.cc:455] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c98de5f0a6f142118e01d539946946f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98de5f0a6f142118e01d539946946f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40965 } } }
I20260806 04:50:22.676152 28598 sys_catalog.cc:458] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:22.676127 28599 sys_catalog.cc:455] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c98de5f0a6f142118e01d539946946f9. Latest consensus state: current_term: 1 leader_uuid: "c98de5f0a6f142118e01d539946946f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98de5f0a6f142118e01d539946946f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40965 } } }
I20260806 04:50:22.676559 28599 sys_catalog.cc:458] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:22.678511 28602 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:22.683908 28602 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:22.691946 28602 catalog_manager.cc:1347] Generated new cluster ID: b01bf61462e8478ead99e7cd1a906788
I20260806 04:50:22.692052 28602 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:22.725042 28602 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:22.725548 28602 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:22.739125 28602 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c98de5f0a6f142118e01d539946946f9: Generated new TSK 0
I20260806 04:50:22.740123 28602 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:22.754573 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 28519
W20260806 04:50:22.755712 28582 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44671
W20260806 04:50:22.756492 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 28519: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:50:22.756651 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 28519
2026-08-06T04:50:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1948 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:22 dist-test-slave-0b58 krb5kdc[28618](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:22 dist-test-slave-0b58 krb5kdc[28618](info): set up 2 sockets
Aug 06 04:50:22 dist-test-slave-0b58 krb5kdc[28618](info): commencing operation
krb5kdc: starting...
W20260806 04:50:23.862826 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:24 dist-test-slave-0b58 krb5kdc[28618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 04:50:24.151042 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37603
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37603
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:24.483763 28631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:24.484056 28631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:24.484241 28631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:24.491426 28631 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:24.491552 28631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:24.491636 28631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:24.491731 28631 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:24.491811 28631 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:24.501405 28631 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37603
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:24.502579 28631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:24.503804 28631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:24.515203 28639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:24.515300 28636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:24.515172 28637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:24.516144 28631 server_base.cc:1034] running on GCE node
I20260806 04:50:24.516880 28631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:24.518149 28631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:24.519379 28631 hybrid_clock.cc:648] HybridClock initialized: now 1785991824519317 us; error 44 us; skew 500 ppm
I20260806 04:50:24.519709 28631 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:24 dist-test-slave-0b58 krb5kdc[28618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991824, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:24.522789 28631 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 04:50:24.524124 28631 webserver.cc:460] Webserver started at http://127.0.0.1:35579/ using document root <none> and password file <none>
I20260806 04:50:24.524822 28631 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:24.524981 28631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:24.525306 28631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:24.528812 28631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "99cd12ed466e48ea8765ea9405b3ba89"
format_stamp: "Formatted at 2026-08-06 04:50:24 on dist-test-slave-0b58"
server_key: "bae5554213478461ad3cf9972a772425"
server_key_iv: "f3f2c9572da31f8a2241bb2a07267ea1"
server_key_version: "encryptionkey@0"
I20260806 04:50:24.529793 28631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "99cd12ed466e48ea8765ea9405b3ba89"
format_stamp: "Formatted at 2026-08-06 04:50:24 on dist-test-slave-0b58"
server_key: "bae5554213478461ad3cf9972a772425"
server_key_iv: "f3f2c9572da31f8a2241bb2a07267ea1"
server_key_version: "encryptionkey@0"
I20260806 04:50:24.534834 28631 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 04:50:24.538100 28646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:24.539328 28631 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 04:50:24.539515 28631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "99cd12ed466e48ea8765ea9405b3ba89"
format_stamp: "Formatted at 2026-08-06 04:50:24 on dist-test-slave-0b58"
server_key: "bae5554213478461ad3cf9972a772425"
server_key_iv: "f3f2c9572da31f8a2241bb2a07267ea1"
server_key_version: "encryptionkey@0"
I20260806 04:50:24.539697 28631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:24.564075 28631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:24.568316 28631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:24.568612 28631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:24.587239 28631 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37603
I20260806 04:50:24.587271 28697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37603 every 8 connection(s)
I20260806 04:50:24.588639 28631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:24.589335 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 28631
I20260806 04:50:24.589538 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:24.590099 7623 external_mini_cluster.cc:1428] Setting key 90cf7f68396dae4b8716d3bd005d0e0f
I20260806 04:50:24.592938 28698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 04:50:24 dist-test-slave-0b58 krb5kdc[28618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 04:50:24.603377 28698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89: Bootstrap starting.
I20260806 04:50:24.606778 28698 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:24.607901 28698 log.cc:824] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:24.611107 28698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89: No bootstrap required, opened a new log
I20260806 04:50:24.611640 28701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:24.591850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42225 (local address 127.0.0.1:37603)
0806 04:50:24.592639 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:24.592650 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:24.592690 (+ 40us) server_negotiation.cc:407] Connection header received
0806 04:50:24.594423 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:24.594444 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:24.594796 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:24.595192 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:24.596715 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:24.598061 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:24.599296 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:24.599955 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:24.600186 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:24.604348 (+ 4162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:24.604357 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:24.604369 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:24.604409 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:24.607444 (+ 3035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:24.608320 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:24.608328 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:24.608334 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:24.608624 (+ 290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:24.609032 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:24.609039 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:24.609051 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:24.609620 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:24.609839 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:24.610297 (+ 458us) server_negotiation.cc:299] Negotiation successful
0806 04:50:24.610588 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":385,"threads_started":1}
I20260806 04:50:24.615502 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:24.621601 28698 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99cd12ed466e48ea8765ea9405b3ba89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37603 } }
I20260806 04:50:24.622078 28698 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:24.622189 28698 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99cd12ed466e48ea8765ea9405b3ba89, State: Initialized, Role: FOLLOWER
I20260806 04:50:24.622865 28698 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99cd12ed466e48ea8765ea9405b3ba89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37603 } }
I20260806 04:50:24.623152 28698 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:24.623304 28698 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:24.623481 28698 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:24.626466 28698 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99cd12ed466e48ea8765ea9405b3ba89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37603 } }
I20260806 04:50:24.626938 28698 leader_election.cc:302] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99cd12ed466e48ea8765ea9405b3ba89; no voters:
I20260806 04:50:24.627624 28698 leader_election.cc:288] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:24.627769 28708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:24.629535 28698 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:24.632865 28708 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [term 1 LEADER]: Becoming Leader. State: Replica: 99cd12ed466e48ea8765ea9405b3ba89, State: Running, Role: LEADER
I20260806 04:50:24.633443 28708 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99cd12ed466e48ea8765ea9405b3ba89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37603 } }
I20260806 04:50:24.636137 28710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99cd12ed466e48ea8765ea9405b3ba89. Latest consensus state: current_term: 1 leader_uuid: "99cd12ed466e48ea8765ea9405b3ba89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99cd12ed466e48ea8765ea9405b3ba89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37603 } } }
I20260806 04:50:24.636590 28710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:24.637187 28709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99cd12ed466e48ea8765ea9405b3ba89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99cd12ed466e48ea8765ea9405b3ba89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37603 } } }
I20260806 04:50:24.637614 28709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:24.640031 28701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:24.620777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55907 (local address 127.0.0.1:37603)
0806 04:50:24.620993 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:24.621002 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:24.621359 (+ 357us) server_negotiation.cc:407] Connection header received
0806 04:50:24.621524 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:24.621528 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:24.621582 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:24.621659 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:24.623600 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:24.624441 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:24.626166 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:24.626620 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:24.626740 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:24.630159 (+ 3419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:24.630165 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:24.630170 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:24.630205 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:24.634812 (+ 4607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:24.635891 (+ 1079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:24.635899 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:24.635905 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:24.636164 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:24.636796 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:24.636807 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:24.636813 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:24.637540 (+ 727us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:24.637906 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:24.639237 (+ 1331us) server_negotiation.cc:299] Negotiation successful
0806 04:50:24.639528 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 04:50:24.642987 28715 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:24.647790 28715 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:24.656193 28715 catalog_manager.cc:1347] Generated new cluster ID: 7f60ab78b78e4035bdaa28cefe84b81f
I20260806 04:50:24.656324 28715 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:24.670786 28715 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:24.672078 28715 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:24.678321 28715 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99cd12ed466e48ea8765ea9405b3ba89: Generated new TSK 0
I20260806 04:50:24.678998 28715 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:24.685989 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 28631
I20260806 04:50:24.687134 28693 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:24.775321 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 28631
2026-08-06T04:50:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2018 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:24 dist-test-slave-0b58 krb5kdc[28731](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:24 dist-test-slave-0b58 krb5kdc[28731](info): set up 2 sockets
Aug 06 04:50:24 dist-test-slave-0b58 krb5kdc[28731](info): commencing operation
krb5kdc: starting...
W20260806 04:50:25.878728 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.065s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:26 dist-test-slave-0b58 krb5kdc[28731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 04:50:26.171550 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36853
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:26.503252 28744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:26.503509 28744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:26.503660 28744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:26.510603 28744 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:26.510699 28744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:26.510823 28744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:26.510906 28744 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:26.510964 28744 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:26.520442 28744 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36853
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:26.521584 28744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:26.522759 28744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:26.533970 28749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:26.534041 28752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:26.534019 28750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:26.535141 28744 server_base.cc:1034] running on GCE node
I20260806 04:50:26.536020 28744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:26.537731 28744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:26.538978 28744 hybrid_clock.cc:648] HybridClock initialized: now 1785991826538923 us; error 45 us; skew 500 ppm
I20260806 04:50:26.539300 28744 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:26 dist-test-slave-0b58 krb5kdc[28731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991826, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:26.542343 28744 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 04:50:26.543615 28744 webserver.cc:460] Webserver started at http://127.0.0.1:39265/ using document root <none> and password file <none>
I20260806 04:50:26.544237 28744 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:26.544412 28744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:26.544699 28744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:26.547530 28744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "fe3c2caa5b7d4d29b26f9695ab164983"
format_stamp: "Formatted at 2026-08-06 04:50:26 on dist-test-slave-0b58"
server_key: "d7aa38c36e7f9c54b1b2b740abd740a5"
server_key_iv: "25d437b03607aba4884d7e541ba2b2b3"
server_key_version: "encryptionkey@0"
I20260806 04:50:26.548300 28744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "fe3c2caa5b7d4d29b26f9695ab164983"
format_stamp: "Formatted at 2026-08-06 04:50:26 on dist-test-slave-0b58"
server_key: "d7aa38c36e7f9c54b1b2b740abd740a5"
server_key_iv: "25d437b03607aba4884d7e541ba2b2b3"
server_key_version: "encryptionkey@0"
I20260806 04:50:26.553115 28744 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 04:50:26.556084 28759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:26.557330 28744 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 04:50:26.557483 28744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "fe3c2caa5b7d4d29b26f9695ab164983"
format_stamp: "Formatted at 2026-08-06 04:50:26 on dist-test-slave-0b58"
server_key: "d7aa38c36e7f9c54b1b2b740abd740a5"
server_key_iv: "25d437b03607aba4884d7e541ba2b2b3"
server_key_version: "encryptionkey@0"
I20260806 04:50:26.557677 28744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:26.574342 28744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:26.578409 28744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:26.578691 28744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:26.596985 28744 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36853
I20260806 04:50:26.597023 28810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36853 every 8 connection(s)
I20260806 04:50:26.598282 28744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:26.599975 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 28744
I20260806 04:50:26.600163 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:26.600765 7623 external_mini_cluster.cc:1428] Setting key fd8012e94455b67e9b989d6a81fd6a8f
I20260806 04:50:26.602402 28811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:26.613595 28814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:26.602498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39933 (local address 127.0.0.1:36853)
0806 04:50:26.603229 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:26.603239 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:26.603277 (+ 38us) server_negotiation.cc:407] Connection header received
0806 04:50:26.604909 (+ 1632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:26.604928 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:26.605286 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:26.605684 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:26.606227 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:26.607568 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:26.608951 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:26.609599 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:26.609800 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:26.610980 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:26.610987 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:26.610999 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:26.611612 (+ 613us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:26.611704 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:26.611738 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:26.611870 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:26.612090 (+ 220us) server_negotiation.cc:299] Negotiation successful
0806 04:50:26.612565 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":345,"threads_started":1}
I20260806 04:50:26.613673 28811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983: Bootstrap starting.
I20260806 04:50:26.616671 28811 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:26.616933 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:26.617863 28811 log.cc:824] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:26.620985 28811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983: No bootstrap required, opened a new log
I20260806 04:50:26.628337 28814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:26.621819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36407 (local address 127.0.0.1:36853)
0806 04:50:26.621979 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:26.621985 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:26.622488 (+ 503us) server_negotiation.cc:407] Connection header received
0806 04:50:26.622608 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:26.622613 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:26.622685 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:26.622793 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:26.623250 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:26.624413 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:26.625781 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:26.626515 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:26.626639 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:26.627607 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:26.627613 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:26.627618 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:26.627637 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:26.627678 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:26.627717 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:26.627815 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:26.627926 (+ 111us) server_negotiation.cc:299] Negotiation successful
0806 04:50:26.628016 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 04:50:26.630739 28811 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe3c2caa5b7d4d29b26f9695ab164983" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36853 } }
I20260806 04:50:26.631060 28811 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:26.631131 28811 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe3c2caa5b7d4d29b26f9695ab164983, State: Initialized, Role: FOLLOWER
I20260806 04:50:26.631647 28811 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe3c2caa5b7d4d29b26f9695ab164983" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36853 } }
I20260806 04:50:26.631875 28811 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:26.632002 28811 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:26.632140 28811 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:26.634545 28811 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe3c2caa5b7d4d29b26f9695ab164983" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36853 } }
I20260806 04:50:26.634948 28811 leader_election.cc:302] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe3c2caa5b7d4d29b26f9695ab164983; no voters:
I20260806 04:50:26.635421 28811 leader_election.cc:288] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:26.635563 28821 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:26.636271 28821 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [term 1 LEADER]: Becoming Leader. State: Replica: fe3c2caa5b7d4d29b26f9695ab164983, State: Running, Role: LEADER
I20260806 04:50:26.636775 28821 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe3c2caa5b7d4d29b26f9695ab164983" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36853 } }
I20260806 04:50:26.637382 28811 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:26.639791 28823 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe3c2caa5b7d4d29b26f9695ab164983. Latest consensus state: current_term: 1 leader_uuid: "fe3c2caa5b7d4d29b26f9695ab164983" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe3c2caa5b7d4d29b26f9695ab164983" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36853 } } }
I20260806 04:50:26.639762 28822 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe3c2caa5b7d4d29b26f9695ab164983" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe3c2caa5b7d4d29b26f9695ab164983" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36853 } } }
I20260806 04:50:26.640285 28822 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:26.640565 28823 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:26.644924 28826 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:26.650156 28826 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:26.658648 28826 catalog_manager.cc:1347] Generated new cluster ID: 8423303e59e3489c8ae61e57ed4bbaa1
I20260806 04:50:26.658769 28826 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:26.673313 28826 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:26.674966 28826 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:26.698124 28826 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe3c2caa5b7d4d29b26f9695ab164983: Generated new TSK 0
I20260806 04:50:26.698920 28826 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:26.711079 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 28744
W20260806 04:50:26.712509 28806 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39933
W20260806 04:50:26.713236 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 28744: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:50:26.713402 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 28744
2026-08-06T04:50:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1937 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:26 dist-test-slave-0b58 krb5kdc[28842](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:26 dist-test-slave-0b58 krb5kdc[28842](info): set up 2 sockets
Aug 06 04:50:26 dist-test-slave-0b58 krb5kdc[28842](info): commencing operation
krb5kdc: starting...
W20260806 04:50:27.838472 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.003s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:28 dist-test-slave-0b58 krb5kdc[28842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991828, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 04:50:28.123955 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43869
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:28.465596 28855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:28.465881 28855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:28.466054 28855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:28.473316 28855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:28.473450 28855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:28.473534 28855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:28.473646 28855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:28.473719 28855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:28.483498 28855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:28.484851 28855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:28.486217 28855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:28.498193 28860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:28.498296 28861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:28.498344 28863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:28.499293 28855 server_base.cc:1034] running on GCE node
I20260806 04:50:28.500123 28855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:28.501528 28855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:28.502853 28855 hybrid_clock.cc:648] HybridClock initialized: now 1785991828502804 us; error 38 us; skew 500 ppm
I20260806 04:50:28.503239 28855 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:28 dist-test-slave-0b58 krb5kdc[28842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991828, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:28.511592 28855 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 04:50:28.513368 28855 webserver.cc:460] Webserver started at http://127.0.0.1:38149/ using document root <none> and password file <none>
I20260806 04:50:28.514112 28855 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:28.514268 28855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:28.514598 28855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:28.517834 28855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "7ecab9c437c141ab896b4e3bd6008ac3"
format_stamp: "Formatted at 2026-08-06 04:50:28 on dist-test-slave-0b58"
server_key: "eb54d955fe9a106ca5331c19ee939b20"
server_key_iv: "1ecda3950feb7d4be345da6f57924b74"
server_key_version: "encryptionkey@0"
I20260806 04:50:28.518651 28855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "7ecab9c437c141ab896b4e3bd6008ac3"
format_stamp: "Formatted at 2026-08-06 04:50:28 on dist-test-slave-0b58"
server_key: "eb54d955fe9a106ca5331c19ee939b20"
server_key_iv: "1ecda3950feb7d4be345da6f57924b74"
server_key_version: "encryptionkey@0"
I20260806 04:50:28.523995 28855 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 04:50:28.527514 28870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:28.528946 28855 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:50:28.529132 28855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "7ecab9c437c141ab896b4e3bd6008ac3"
format_stamp: "Formatted at 2026-08-06 04:50:28 on dist-test-slave-0b58"
server_key: "eb54d955fe9a106ca5331c19ee939b20"
server_key_iv: "1ecda3950feb7d4be345da6f57924b74"
server_key_version: "encryptionkey@0"
I20260806 04:50:28.529353 28855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:28.535248 28855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:28.539563 28855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:28.539875 28855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:28.559928 28855 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43869
I20260806 04:50:28.560016 28921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43869 every 8 connection(s)
I20260806 04:50:28.561399 28855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:28.564793 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 28855
I20260806 04:50:28.565008 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:28.565527 28922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:28.565606 7623 external_mini_cluster.cc:1428] Setting key c17ef37fd4b03a468f193633c4b9b10a
I20260806 04:50:28.573629 28925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:28.567429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50603 (local address 127.0.0.1:43869)
0806 04:50:28.568237 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:28.568248 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:28.568351 (+ 103us) server_negotiation.cc:407] Connection header received
0806 04:50:28.570322 (+ 1971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:28.570343 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:28.570660 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:28.570977 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:28.572060 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:28.572066 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:28.572081 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:28.572098 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:28.572155 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:28.572177 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:28.572426 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:28.572530 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 04:50:28.572750 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":371,"threads_started":1}
I20260806 04:50:28.577292 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:28.579198 28922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3: Bootstrap starting.
I20260806 04:50:28.582852 28922 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:28.584173 28925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:28.581648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42165 (local address 127.0.0.1:43869)
0806 04:50:28.581842 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:28.581849 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:28.582196 (+ 347us) server_negotiation.cc:407] Connection header received
0806 04:50:28.582386 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:28.582390 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:28.582435 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:28.582506 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:28.583523 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:28.583526 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:28.583530 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:28.583543 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:28.583581 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:28.583594 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:28.583686 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:28.583828 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 04:50:28.583872 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 04:50:28.584292 28922 log.cc:824] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:28.587097 28922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3: No bootstrap required, opened a new log
I20260806 04:50:28.594581 28922 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecab9c437c141ab896b4e3bd6008ac3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43869 } }
I20260806 04:50:28.594921 28922 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:28.595059 28922 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ecab9c437c141ab896b4e3bd6008ac3, State: Initialized, Role: FOLLOWER
I20260806 04:50:28.595677 28922 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecab9c437c141ab896b4e3bd6008ac3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43869 } }
I20260806 04:50:28.595883 28922 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:28.596060 28922 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:28.596220 28922 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:28.598701 28922 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecab9c437c141ab896b4e3bd6008ac3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43869 } }
I20260806 04:50:28.599192 28922 leader_election.cc:302] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ecab9c437c141ab896b4e3bd6008ac3; no voters:
I20260806 04:50:28.599776 28922 leader_election.cc:288] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:28.599869 28933 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:28.600591 28933 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ecab9c437c141ab896b4e3bd6008ac3, State: Running, Role: LEADER
I20260806 04:50:28.601167 28933 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecab9c437c141ab896b4e3bd6008ac3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43869 } }
I20260806 04:50:28.601944 28922 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:28.604079 28934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ecab9c437c141ab896b4e3bd6008ac3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecab9c437c141ab896b4e3bd6008ac3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43869 } } }
I20260806 04:50:28.604600 28934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:28.604444 28935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ecab9c437c141ab896b4e3bd6008ac3. Latest consensus state: current_term: 1 leader_uuid: "7ecab9c437c141ab896b4e3bd6008ac3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecab9c437c141ab896b4e3bd6008ac3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43869 } } }
I20260806 04:50:28.604743 28935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:28.606544 28939 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:28.612138 28939 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:28.621378 28939 catalog_manager.cc:1347] Generated new cluster ID: ae8b868b144c4964b81490dabb30f953
I20260806 04:50:28.621506 28939 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:28.642006 28939 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:28.642460 28939 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:28.651875 28939 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ecab9c437c141ab896b4e3bd6008ac3: Generated new TSK 0
I20260806 04:50:28.652698 28939 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:28.659664 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 28855
W20260806 04:50:28.660847 28917 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:50603
W20260806 04:50:28.661526 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 28855: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:50:28.661679 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 28855
2026-08-06T04:50:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1948 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:28 dist-test-slave-0b58 krb5kdc[28955](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:28 dist-test-slave-0b58 krb5kdc[28955](info): set up 2 sockets
Aug 06 04:50:28 dist-test-slave-0b58 krb5kdc[28955](info): commencing operation
krb5kdc: starting...
W20260806 04:50:29.818497 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:30 dist-test-slave-0b58 krb5kdc[28955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 04:50:30.113467 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37589
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37589
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:30.451088 28968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:30.451417 28968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:30.451613 28968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:30.458566 28968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:30.458655 28968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:30.458722 28968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:30.458774 28968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:30.458810 28968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:30.468164 28968 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:30.469277 28968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:30.470484 28968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:30.481980 28974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:30.482043 28973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:30.482017 28976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:30.483269 28968 server_base.cc:1034] running on GCE node
I20260806 04:50:30.483911 28968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:30.485208 28968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:30.486433 28968 hybrid_clock.cc:648] HybridClock initialized: now 1785991830486396 us; error 40 us; skew 500 ppm
I20260806 04:50:30.486769 28968 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:30 dist-test-slave-0b58 krb5kdc[28955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991830, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:30.489717 28968 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 04:50:30.491071 28968 webserver.cc:460] Webserver started at http://127.0.0.1:46601/ using document root <none> and password file <none>
I20260806 04:50:30.491681 28968 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:30.491773 28968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:30.491997 28968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:30.494822 28968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "be5be0566b4546fc923d83d69ddb6102"
format_stamp: "Formatted at 2026-08-06 04:50:30 on dist-test-slave-0b58"
server_key: "17833ab2e1944e63b752c390d9df5618"
server_key_iv: "8a0d151ef2d659de4d3619f165132669"
server_key_version: "encryptionkey@0"
I20260806 04:50:30.495555 28968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "be5be0566b4546fc923d83d69ddb6102"
format_stamp: "Formatted at 2026-08-06 04:50:30 on dist-test-slave-0b58"
server_key: "17833ab2e1944e63b752c390d9df5618"
server_key_iv: "8a0d151ef2d659de4d3619f165132669"
server_key_version: "encryptionkey@0"
I20260806 04:50:30.500454 28968 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260806 04:50:30.503695 28983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:30.504912 28968 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:50:30.505084 28968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "be5be0566b4546fc923d83d69ddb6102"
format_stamp: "Formatted at 2026-08-06 04:50:30 on dist-test-slave-0b58"
server_key: "17833ab2e1944e63b752c390d9df5618"
server_key_iv: "8a0d151ef2d659de4d3619f165132669"
server_key_version: "encryptionkey@0"
I20260806 04:50:30.505254 28968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:30.518556 28968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:30.522506 28968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:30.522787 28968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:30.540995 28968 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37589
I20260806 04:50:30.541038 29034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37589 every 8 connection(s)
I20260806 04:50:30.542269 28968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:30.543262 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 28968
I20260806 04:50:30.543457 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:30.544027 7623 external_mini_cluster.cc:1428] Setting key 3da91098cbbe64499d78e9baf3f57c32
I20260806 04:50:30.546867 29035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 04:50:30 dist-test-slave-0b58 krb5kdc[28955](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 04:50:30.559156 29035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102: Bootstrap starting.
I20260806 04:50:30.563390 29035 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:30.564671 29035 log.cc:824] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:30.567983 29035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102: No bootstrap required, opened a new log
I20260806 04:50:30.568149 29038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:30.545840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:47031 (local address 127.0.0.1:37589)
0806 04:50:30.546633 (+ 793us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:30.546644 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:30.546684 (+ 40us) server_negotiation.cc:407] Connection header received
0806 04:50:30.548363 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:30.548384 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:30.548733 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:30.549112 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:30.550883 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:30.552974 (+ 2091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:30.554215 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:30.555251 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:30.555434 (+ 183us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:30.559472 (+ 4038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:30.559485 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:30.559502 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:30.559551 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:30.563585 (+ 4034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:30.564387 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:30.564397 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:30.564406 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:30.564608 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:30.565088 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:30.565094 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:30.565100 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:30.565730 (+ 630us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:30.566023 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:30.566509 (+ 486us) server_negotiation.cc:299] Negotiation successful
0806 04:50:30.566815 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":333,"threads_started":1}
I20260806 04:50:30.571929 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:30.575911 29035 raft_consensus.cc:348] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be5be0566b4546fc923d83d69ddb6102" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37589 } }
I20260806 04:50:30.576339 29035 raft_consensus.cc:374] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:30.576520 29035 raft_consensus.cc:729] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5be0566b4546fc923d83d69ddb6102, State: Initialized, Role: FOLLOWER
I20260806 04:50:30.577180 29035 consensus_queue.cc:260] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be5be0566b4546fc923d83d69ddb6102" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37589 } }
I20260806 04:50:30.577483 29035 raft_consensus.cc:388] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:30.577629 29035 raft_consensus.cc:482] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:30.577831 29035 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:30.580694 29035 raft_consensus.cc:504] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be5be0566b4546fc923d83d69ddb6102" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37589 } }
I20260806 04:50:30.581233 29035 leader_election.cc:302] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be5be0566b4546fc923d83d69ddb6102; no voters:
I20260806 04:50:30.581871 29035 leader_election.cc:288] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:30.582052 29045 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:30.583127 29045 raft_consensus.cc:686] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [term 1 LEADER]: Becoming Leader. State: Replica: be5be0566b4546fc923d83d69ddb6102, State: Running, Role: LEADER
I20260806 04:50:30.583822 29045 consensus_queue.cc:237] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be5be0566b4546fc923d83d69ddb6102" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37589 } }
I20260806 04:50:30.584021 29035 sys_catalog.cc:564] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:30.592608 29047 sys_catalog.cc:455] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be5be0566b4546fc923d83d69ddb6102. Latest consensus state: current_term: 1 leader_uuid: "be5be0566b4546fc923d83d69ddb6102" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be5be0566b4546fc923d83d69ddb6102" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37589 } } }
I20260806 04:50:30.593009 29047 sys_catalog.cc:458] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:30.593554 29046 sys_catalog.cc:455] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be5be0566b4546fc923d83d69ddb6102" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be5be0566b4546fc923d83d69ddb6102" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37589 } } }
I20260806 04:50:30.593863 29046 sys_catalog.cc:458] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:30.596010 29038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:30.576203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:59235 (local address 127.0.0.1:37589)
0806 04:50:30.576468 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:30.576476 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:30.576837 (+ 361us) server_negotiation.cc:407] Connection header received
0806 04:50:30.577010 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:30.577014 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:30.577068 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:30.577142 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:30.579066 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:30.579797 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:30.581646 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:30.582472 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:30.583399 (+ 927us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:30.586123 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:30.586132 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:30.586157 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:30.586225 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:30.591167 (+ 4942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:30.592223 (+ 1056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:30.592231 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:30.592236 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:30.592516 (+ 280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:30.593140 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:30.593147 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:30.593152 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:30.593589 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:30.593940 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:30.595407 (+ 1467us) server_negotiation.cc:299] Negotiation successful
0806 04:50:30.595625 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260806 04:50:30.596407 29053 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:30.603598 29053 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:30.613188 29053 catalog_manager.cc:1347] Generated new cluster ID: 73132a93ee8046e0a4c32d7b2c93b6d9
I20260806 04:50:30.613291 29053 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:30.652669 29053 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:30.653941 29053 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:30.664464 29053 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be5be0566b4546fc923d83d69ddb6102: Generated new TSK 0
I20260806 04:50:30.665257 29053 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:30.674000 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 28968
I20260806 04:50:30.675097 29030 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:30.767076 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 28968
W20260806 04:50:30.783872 28953 connection.cc:535] client connection to 127.0.0.1:37589 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37589): Connection reset by peer (error 104)
2026-08-06T04:50:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2103 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:30 dist-test-slave-0b58 krb5kdc[29068](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:30 dist-test-slave-0b58 krb5kdc[29068](info): set up 2 sockets
Aug 06 04:50:30 dist-test-slave-0b58 krb5kdc[29068](info): commencing operation
krb5kdc: starting...
W20260806 04:50:31.890970 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.001s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:32 dist-test-slave-0b58 krb5kdc[29068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 04:50:32.199832 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38925
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:32.533553 29081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:32.533820 29081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:32.534000 29081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:32.541060 29081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:32.541158 29081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:32.541292 29081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:32.541399 29081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:32.541479 29081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:32.551038 29081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:32.552338 29081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:32.553619 29081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:32.566272 29086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:32.566279 29087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:32.566372 29089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:32.567000 29081 server_base.cc:1034] running on GCE node
I20260806 04:50:32.567902 29081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:32.569360 29081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:32.570621 29081 hybrid_clock.cc:648] HybridClock initialized: now 1785991832570586 us; error 45 us; skew 500 ppm
I20260806 04:50:32.571040 29081 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:32 dist-test-slave-0b58 krb5kdc[29068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991832, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:32.574230 29081 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 04:50:32.575634 29081 webserver.cc:460] Webserver started at http://127.0.0.1:46693/ using document root <none> and password file <none>
I20260806 04:50:32.576375 29081 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:32.576534 29081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:32.576879 29081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:32.579932 29081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "a2a12916a31c4063a28b053fb4bc0389"
format_stamp: "Formatted at 2026-08-06 04:50:32 on dist-test-slave-0b58"
server_key: "6340272053b95e01cd8d8189ddf26ad7"
server_key_iv: "16e9970a0372b24e21558c383ffe0482"
server_key_version: "encryptionkey@0"
I20260806 04:50:32.580710 29081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "a2a12916a31c4063a28b053fb4bc0389"
format_stamp: "Formatted at 2026-08-06 04:50:32 on dist-test-slave-0b58"
server_key: "6340272053b95e01cd8d8189ddf26ad7"
server_key_iv: "16e9970a0372b24e21558c383ffe0482"
server_key_version: "encryptionkey@0"
I20260806 04:50:32.585767 29081 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:50:32.589206 29096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:32.590366 29081 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:50:32.590559 29081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "a2a12916a31c4063a28b053fb4bc0389"
format_stamp: "Formatted at 2026-08-06 04:50:32 on dist-test-slave-0b58"
server_key: "6340272053b95e01cd8d8189ddf26ad7"
server_key_iv: "16e9970a0372b24e21558c383ffe0482"
server_key_version: "encryptionkey@0"
I20260806 04:50:32.590756 29081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:32.610733 29081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:32.615176 29081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:32.615468 29081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:32.633620 29081 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38925
I20260806 04:50:32.633661 29147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38925 every 8 connection(s)
I20260806 04:50:32.634967 29081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:32.638489 29148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:32.642163 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 29081
I20260806 04:50:32.642347 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:32.642777 7623 external_mini_cluster.cc:1428] Setting key 496a0d0a7993742be7a7aba3f7d840fd
I20260806 04:50:32.650660 29148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389: Bootstrap starting.
I20260806 04:50:32.654148 29148 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:32.655256 29148 log.cc:824] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:32.655728 29151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:32.644550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:55937 (local address 127.0.0.1:38925)
0806 04:50:32.645280 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:32.645291 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:32.645330 (+ 39us) server_negotiation.cc:407] Connection header received
0806 04:50:32.646866 (+ 1536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:32.646887 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:32.647261 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:32.647629 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:32.648218 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:32.649557 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:32.651418 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:32.652085 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:32.652223 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:32.653541 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:32.653548 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:32.653561 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:32.654048 (+ 487us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:32.654119 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:32.654149 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:32.654318 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:32.654611 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 04:50:32.654748 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":320,"threads_started":1}
I20260806 04:50:32.658128 29148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389: No bootstrap required, opened a new log
I20260806 04:50:32.659457 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:32.668388 29148 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a12916a31c4063a28b053fb4bc0389" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38925 } }
I20260806 04:50:32.668850 29148 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:32.668977 29148 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a12916a31c4063a28b053fb4bc0389, State: Initialized, Role: FOLLOWER
I20260806 04:50:32.669682 29148 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a12916a31c4063a28b053fb4bc0389" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38925 } }
I20260806 04:50:32.669994 29148 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:32.670157 29148 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:32.670332 29148 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:32.671701 29151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:32.664688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:59789 (local address 127.0.0.1:38925)
0806 04:50:32.664896 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:32.664904 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:32.665365 (+ 461us) server_negotiation.cc:407] Connection header received
0806 04:50:32.665548 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:32.665551 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:32.665608 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:32.665683 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:32.666316 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:32.667079 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:32.669019 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:32.669540 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:32.669630 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:32.670923 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:32.670928 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:32.670934 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:32.670949 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:32.670985 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:32.671003 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:32.671090 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:32.671308 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 04:50:32.671351 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 04:50:32.673269 29148 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a12916a31c4063a28b053fb4bc0389" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38925 } }
I20260806 04:50:32.673745 29148 leader_election.cc:302] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2a12916a31c4063a28b053fb4bc0389; no voters:
I20260806 04:50:32.674319 29148 leader_election.cc:288] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:32.674453 29158 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:32.675140 29158 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [term 1 LEADER]: Becoming Leader. State: Replica: a2a12916a31c4063a28b053fb4bc0389, State: Running, Role: LEADER
I20260806 04:50:32.675688 29158 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a12916a31c4063a28b053fb4bc0389" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38925 } }
I20260806 04:50:32.676522 29148 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:32.678332 29160 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2a12916a31c4063a28b053fb4bc0389. Latest consensus state: current_term: 1 leader_uuid: "a2a12916a31c4063a28b053fb4bc0389" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a12916a31c4063a28b053fb4bc0389" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38925 } } }
I20260806 04:50:32.678524 29159 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2a12916a31c4063a28b053fb4bc0389" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a12916a31c4063a28b053fb4bc0389" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38925 } } }
I20260806 04:50:32.678789 29159 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:32.678789 29160 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:32.679617 29164 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:32.685580 29164 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:32.693768 29164 catalog_manager.cc:1347] Generated new cluster ID: 118e2919ba19456d8c7f7a8273a0525d
I20260806 04:50:32.693914 29164 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:32.722553 29164 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:32.723908 29164 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:32.731047 29164 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2a12916a31c4063a28b053fb4bc0389: Generated new TSK 0
I20260806 04:50:32.732026 29164 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:32.745476 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29081
W20260806 04:50:32.746897 29143 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.101:55937
W20260806 04:50:32.747776 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29081: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:50:32.747929 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 29081
W20260806 04:50:32.766885 29066 connection.cc:535] client connection to 127.0.0.1:38925 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38925): Connection reset by peer (error 104)
2026-08-06T04:50:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1982 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:32 dist-test-slave-0b58 krb5kdc[29179](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:32 dist-test-slave-0b58 krb5kdc[29179](info): set up 2 sockets
Aug 06 04:50:32 dist-test-slave-0b58 krb5kdc[29179](info): commencing operation
krb5kdc: starting...
W20260806 04:50:33.870796 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.004s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:34 dist-test-slave-0b58 krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 04:50:34.183094 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32907
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32907
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:34.517278 29192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:34.517552 29192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:34.517746 29192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:34.524783 29192 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:34.524887 29192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:34.525017 29192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:34.525122 29192 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:34.525198 29192 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:34.534974 29192 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:34.536278 29192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:34.537505 29192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:34.549232 29197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:34.549197 29198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:34.549281 29200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:34.550352 29192 server_base.cc:1034] running on GCE node
I20260806 04:50:34.551127 29192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:34.552470 29192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:34.553669 29192 hybrid_clock.cc:648] HybridClock initialized: now 1785991834553629 us; error 38 us; skew 500 ppm
I20260806 04:50:34.554029 29192 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:34 dist-test-slave-0b58 krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991834, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:34.562076 29192 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 04:50:34.563563 29192 webserver.cc:460] Webserver started at http://127.0.0.1:45641/ using document root <none> and password file <none>
I20260806 04:50:34.564230 29192 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:34.564436 29192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:34.564810 29192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:34.568620 29192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "8709ec9b9b2f4d77a23beb4f4ab5949c"
format_stamp: "Formatted at 2026-08-06 04:50:34 on dist-test-slave-0b58"
server_key: "bdd3ad51c6f88525f98b27855790737c"
server_key_iv: "32914d3602c0d0eeff1567ac2715f016"
server_key_version: "encryptionkey@0"
I20260806 04:50:34.569352 29192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "8709ec9b9b2f4d77a23beb4f4ab5949c"
format_stamp: "Formatted at 2026-08-06 04:50:34 on dist-test-slave-0b58"
server_key: "bdd3ad51c6f88525f98b27855790737c"
server_key_iv: "32914d3602c0d0eeff1567ac2715f016"
server_key_version: "encryptionkey@0"
I20260806 04:50:34.574280 29192 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:50:34.577522 29207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:34.578773 29192 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:50:34.578971 29192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "8709ec9b9b2f4d77a23beb4f4ab5949c"
format_stamp: "Formatted at 2026-08-06 04:50:34 on dist-test-slave-0b58"
server_key: "bdd3ad51c6f88525f98b27855790737c"
server_key_iv: "32914d3602c0d0eeff1567ac2715f016"
server_key_version: "encryptionkey@0"
I20260806 04:50:34.579150 29192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:34.584721 29192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:34.588929 29192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:34.589211 29192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:34.607582 29192 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32907
I20260806 04:50:34.607661 29258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32907 every 8 connection(s)
I20260806 04:50:34.608960 29192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:34.612473 29259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:34.614504 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 29192
I20260806 04:50:34.614686 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:34.615234 7623 external_mini_cluster.cc:1428] Setting key 97f9877becd2af0fd3a10daf7dba5956
I20260806 04:50:34.624863 29262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:34.617271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:49817 (local address 127.0.0.1:32907)
0806 04:50:34.618178 (+ 907us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:34.618193 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:34.618606 (+ 413us) server_negotiation.cc:407] Connection header received
0806 04:50:34.621038 (+ 2432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:34.621068 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:34.621481 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:34.621922 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:34.622918 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:34.622929 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:34.622950 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:34.622968 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:34.623038 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:34.623063 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:34.623288 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:34.623446 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 04:50:34.623642 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":388,"threads_started":1}
I20260806 04:50:34.625922 29259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c: Bootstrap starting.
I20260806 04:50:34.628398 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:34.629274 29259 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:34.630499 29259 log.cc:824] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:34.633812 29259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c: No bootstrap required, opened a new log
I20260806 04:50:34.636245 29262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:34.633806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:38173 (local address 127.0.0.1:32907)
0806 04:50:34.633974 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:34.633980 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:34.634435 (+ 455us) server_negotiation.cc:407] Connection header received
0806 04:50:34.634551 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:34.634556 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:34.634622 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:34.634741 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:34.635610 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:34.635617 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:34.635622 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:34.635641 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:34.635689 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:34.635714 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:34.635843 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:34.635892 (+ 49us) server_negotiation.cc:299] Negotiation successful
0806 04:50:34.635951 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 04:50:34.641954 29259 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8709ec9b9b2f4d77a23beb4f4ab5949c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32907 } }
I20260806 04:50:34.642413 29259 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:34.642544 29259 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8709ec9b9b2f4d77a23beb4f4ab5949c, State: Initialized, Role: FOLLOWER
I20260806 04:50:34.643172 29259 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8709ec9b9b2f4d77a23beb4f4ab5949c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32907 } }
I20260806 04:50:34.643410 29259 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:34.643563 29259 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:34.643731 29259 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:34.645922 29259 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8709ec9b9b2f4d77a23beb4f4ab5949c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32907 } }
I20260806 04:50:34.646412 29259 leader_election.cc:302] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8709ec9b9b2f4d77a23beb4f4ab5949c; no voters:
I20260806 04:50:34.646977 29259 leader_election.cc:288] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:34.647110 29269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:34.647903 29269 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [term 1 LEADER]: Becoming Leader. State: Replica: 8709ec9b9b2f4d77a23beb4f4ab5949c, State: Running, Role: LEADER
I20260806 04:50:34.648670 29269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8709ec9b9b2f4d77a23beb4f4ab5949c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32907 } }
I20260806 04:50:34.649405 29259 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:34.651647 29271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8709ec9b9b2f4d77a23beb4f4ab5949c. Latest consensus state: current_term: 1 leader_uuid: "8709ec9b9b2f4d77a23beb4f4ab5949c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8709ec9b9b2f4d77a23beb4f4ab5949c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32907 } } }
I20260806 04:50:34.651751 29270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8709ec9b9b2f4d77a23beb4f4ab5949c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8709ec9b9b2f4d77a23beb4f4ab5949c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32907 } } }
I20260806 04:50:34.652127 29271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:34.652518 29270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:34.655176 29274 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:34.659996 29274 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:34.668275 29274 catalog_manager.cc:1347] Generated new cluster ID: cb881a8d70c3479a99ec8a6977de9831
I20260806 04:50:34.668382 29274 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:34.679123 29274 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:34.679548 29274 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:34.690586 29274 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8709ec9b9b2f4d77a23beb4f4ab5949c: Generated new TSK 0
I20260806 04:50:34.691466 29274 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:34.702811 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29192
W20260806 04:50:34.704246 29254 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.101:49817
W20260806 04:50:34.704975 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29192: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:50:34.705123 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 29192
2026-08-06T04:50:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1956 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:34 dist-test-slave-0b58 krb5kdc[29290](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:34 dist-test-slave-0b58 krb5kdc[29290](info): set up 2 sockets
Aug 06 04:50:34 dist-test-slave-0b58 krb5kdc[29290](info): commencing operation
krb5kdc: starting...
W20260806 04:50:35.826947 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:36 dist-test-slave-0b58 krb5kdc[29290](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 04:50:36.123591 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44285
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:36.465469 29304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:36.465729 29304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:36.465852 29304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:36.473021 29304 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:36.473127 29304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:36.473264 29304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:36.473378 29304 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:36.473443 29304 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:36.483110 29304 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44285
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:36.484422 29304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:36.485737 29304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:36.497615 29312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:36.497583 29310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:36.498065 29309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:36.498435 29304 server_base.cc:1034] running on GCE node
I20260806 04:50:36.499225 29304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:36.500627 29304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:36.501837 29304 hybrid_clock.cc:648] HybridClock initialized: now 1785991836501785 us; error 47 us; skew 500 ppm
I20260806 04:50:36.502197 29304 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:36 dist-test-slave-0b58 krb5kdc[29290](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991836, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:36.505359 29304 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 04:50:36.506916 29304 webserver.cc:460] Webserver started at http://127.0.0.1:40251/ using document root <none> and password file <none>
I20260806 04:50:36.507601 29304 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:36.507746 29304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:36.508052 29304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:36.511035 29304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "ece4ac44ec1a4b369be2355f2b543df0"
format_stamp: "Formatted at 2026-08-06 04:50:36 on dist-test-slave-0b58"
server_key: "b88fbf174dd56ebf10654cb00ac7296f"
server_key_iv: "55ae991026e53c1d8b4a48c9933738e1"
server_key_version: "encryptionkey@0"
I20260806 04:50:36.511806 29304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "ece4ac44ec1a4b369be2355f2b543df0"
format_stamp: "Formatted at 2026-08-06 04:50:36 on dist-test-slave-0b58"
server_key: "b88fbf174dd56ebf10654cb00ac7296f"
server_key_iv: "55ae991026e53c1d8b4a48c9933738e1"
server_key_version: "encryptionkey@0"
I20260806 04:50:36.516899 29304 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 04:50:36.520383 29319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:36.521651 29304 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:50:36.521840 29304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "ece4ac44ec1a4b369be2355f2b543df0"
format_stamp: "Formatted at 2026-08-06 04:50:36 on dist-test-slave-0b58"
server_key: "b88fbf174dd56ebf10654cb00ac7296f"
server_key_iv: "55ae991026e53c1d8b4a48c9933738e1"
server_key_version: "encryptionkey@0"
I20260806 04:50:36.522035 29304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:36.538120 29304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:36.542613 29304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:36.542923 29304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:36.562245 29304 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44285
I20260806 04:50:36.562275 29370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44285 every 8 connection(s)
I20260806 04:50:36.563701 29304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:36.567459 29371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:36.567978 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 29304
I20260806 04:50:36.568163 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:36.568778 7623 external_mini_cluster.cc:1428] Setting key 92a5953d67ff44953a4f669a20ed0345
I20260806 04:50:36.581063 29371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0: Bootstrap starting.
Aug 06 04:50:36 dist-test-slave-0b58 krb5kdc[29290](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 04:50:36.584251 29371 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:36.585664 29371 log.cc:824] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:36.589172 29371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0: No bootstrap required, opened a new log
I20260806 04:50:36.594444 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:36.570700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:35603 (local address 127.0.0.1:44285)
0806 04:50:36.571463 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:36.571474 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:36.571511 (+ 37us) server_negotiation.cc:407] Connection header received
0806 04:50:36.574683 (+ 3172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:36.574714 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:36.575290 (+ 576us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:36.575718 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:36.577254 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:36.578569 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:36.579853 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:36.580598 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:36.580804 (+ 206us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:36.585629 (+ 4825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:36.585643 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:36.585667 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:36.585716 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:36.589684 (+ 3968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:36.590514 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:36.590522 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:36.590530 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:36.590742 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:36.591199 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:36.591204 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:36.591208 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:36.591923 (+ 715us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:36.592241 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:36.592716 (+ 475us) server_negotiation.cc:299] Negotiation successful
0806 04:50:36.593070 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":330,"threads_started":1}
I20260806 04:50:36.598395 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:36.598801 29371 raft_consensus.cc:348] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ece4ac44ec1a4b369be2355f2b543df0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44285 } }
I20260806 04:50:36.599196 29371 raft_consensus.cc:374] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:36.599305 29371 raft_consensus.cc:729] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ece4ac44ec1a4b369be2355f2b543df0, State: Initialized, Role: FOLLOWER
I20260806 04:50:36.599918 29371 consensus_queue.cc:260] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ece4ac44ec1a4b369be2355f2b543df0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44285 } }
I20260806 04:50:36.600196 29371 raft_consensus.cc:388] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:36.600381 29371 raft_consensus.cc:482] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:36.600528 29371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:36.603673 29371 raft_consensus.cc:504] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ece4ac44ec1a4b369be2355f2b543df0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44285 } }
I20260806 04:50:36.604281 29371 leader_election.cc:302] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ece4ac44ec1a4b369be2355f2b543df0; no voters:
I20260806 04:50:36.605031 29371 leader_election.cc:288] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:36.605093 29381 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:36.606676 29381 raft_consensus.cc:686] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [term 1 LEADER]: Becoming Leader. State: Replica: ece4ac44ec1a4b369be2355f2b543df0, State: Running, Role: LEADER
I20260806 04:50:36.607240 29381 consensus_queue.cc:237] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ece4ac44ec1a4b369be2355f2b543df0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44285 } }
I20260806 04:50:36.607417 29371 sys_catalog.cc:564] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:36.609951 29383 sys_catalog.cc:455] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ece4ac44ec1a4b369be2355f2b543df0. Latest consensus state: current_term: 1 leader_uuid: "ece4ac44ec1a4b369be2355f2b543df0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ece4ac44ec1a4b369be2355f2b543df0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44285 } } }
I20260806 04:50:36.610348 29383 sys_catalog.cc:458] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:36.611605 29382 sys_catalog.cc:455] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ece4ac44ec1a4b369be2355f2b543df0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ece4ac44ec1a4b369be2355f2b543df0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44285 } } }
I20260806 04:50:36.617350 29382 sys_catalog.cc:458] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:36.617331 29389 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:36.627318 29389 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:36.628170 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:36.603447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:57481 (local address 127.0.0.1:44285)
0806 04:50:36.603642 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:36.603650 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:36.604223 (+ 573us) server_negotiation.cc:407] Connection header received
0806 04:50:36.604420 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:36.604423 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:36.604529 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:36.604628 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:36.606668 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:36.607900 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:36.610096 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:36.611835 (+ 1739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:36.611949 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:36.616728 (+ 4779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:36.616737 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:36.616743 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:36.616776 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:36.622840 (+ 6064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:36.623769 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:36.623794 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:36.623800 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:36.623996 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:36.624787 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:36.624795 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:36.624801 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:36.625358 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:36.627091 (+ 1733us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:36.627345 (+ 254us) server_negotiation.cc:299] Negotiation successful
0806 04:50:36.627581 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 04:50:36.637524 29389 catalog_manager.cc:1347] Generated new cluster ID: 5de1a12ec11f4450a9ba7603294e9342
I20260806 04:50:36.637743 29389 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:36.644809 29389 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:36.646512 29389 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:36.656392 29389 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ece4ac44ec1a4b369be2355f2b543df0: Generated new TSK 0
I20260806 04:50:36.657320 29389 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:36.665035 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29304
I20260806 04:50:36.666182 29366 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:36.753531 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 29304
W20260806 04:50:36.772509 29288 connection.cc:535] client connection to 127.0.0.1:44285 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44285): Connection reset by peer (error 104)
2026-08-06T04:50:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2048 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:36 dist-test-slave-0b58 krb5kdc[29403](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:36 dist-test-slave-0b58 krb5kdc[29403](info): set up 2 sockets
Aug 06 04:50:36 dist-test-slave-0b58 krb5kdc[29403](info): commencing operation
krb5kdc: starting...
W20260806 04:50:37.886955 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:38 dist-test-slave-0b58 krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 04:50:38.195323 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45723
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45723
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:38.532601 29416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:38.532864 29416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:38.532955 29416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:38.540062 29416 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:38.540163 29416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:38.540226 29416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:38.540350 29416 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:38.540401 29416 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:38.550357 29416 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45723
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:38.551608 29416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:38.552901 29416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:38.564512 29422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:38.564612 29424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:38.564633 29421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:38.565516 29416 server_base.cc:1034] running on GCE node
I20260806 04:50:38.566237 29416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:38.567512 29416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:38.568746 29416 hybrid_clock.cc:648] HybridClock initialized: now 1785991838568705 us; error 46 us; skew 500 ppm
I20260806 04:50:38.569082 29416 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:38 dist-test-slave-0b58 krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991838, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:38.571997 29416 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 04:50:38.573602 29416 webserver.cc:460] Webserver started at http://127.0.0.1:37127/ using document root <none> and password file <none>
I20260806 04:50:38.574242 29416 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:38.574420 29416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:38.574738 29416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:38.577688 29416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "546b10a9a8c643f0aab44ce295f76187"
format_stamp: "Formatted at 2026-08-06 04:50:38 on dist-test-slave-0b58"
server_key: "20ef9d3ee793b4ae6fd924be80ff1cf3"
server_key_iv: "4c370f492baaabeec60150014312ebe5"
server_key_version: "encryptionkey@0"
I20260806 04:50:38.578464 29416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "546b10a9a8c643f0aab44ce295f76187"
format_stamp: "Formatted at 2026-08-06 04:50:38 on dist-test-slave-0b58"
server_key: "20ef9d3ee793b4ae6fd924be80ff1cf3"
server_key_iv: "4c370f492baaabeec60150014312ebe5"
server_key_version: "encryptionkey@0"
I20260806 04:50:38.584659 29416 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 04:50:38.587929 29431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:38.589186 29416 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:50:38.589370 29416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "546b10a9a8c643f0aab44ce295f76187"
format_stamp: "Formatted at 2026-08-06 04:50:38 on dist-test-slave-0b58"
server_key: "20ef9d3ee793b4ae6fd924be80ff1cf3"
server_key_iv: "4c370f492baaabeec60150014312ebe5"
server_key_version: "encryptionkey@0"
I20260806 04:50:38.589561 29416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:38.625993 29416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:38.629739 29416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:38.630019 29416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:38.648715 29416 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45723
I20260806 04:50:38.648759 29483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45723 every 8 connection(s)
I20260806 04:50:38.650075 29416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:38.653702 29484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:38.655906 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 29416
I20260806 04:50:38.656082 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:38.656587 7623 external_mini_cluster.cc:1428] Setting key 0ac5b714cdb99e8445f30e94aad536d9
I20260806 04:50:38.665086 29484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187: Bootstrap starting.
I20260806 04:50:38.668617 29484 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:38.669648 29487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:38.658345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:39105 (local address 127.0.0.1:45723)
0806 04:50:38.659207 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:38.659218 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:38.659257 (+ 39us) server_negotiation.cc:407] Connection header received
0806 04:50:38.660970 (+ 1713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:38.660993 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:38.661351 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:38.661671 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:38.662251 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:38.663599 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:38.665425 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:38.666062 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:38.666204 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:38.667509 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:38.667516 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:38.667528 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:38.668019 (+ 491us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:38.668091 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:38.668113 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:38.668230 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:38.668547 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 04:50:38.668742 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":402,"threads_started":1}
I20260806 04:50:38.669668 29484 log.cc:824] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:38.672513 29484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187: No bootstrap required, opened a new log
I20260806 04:50:38.673333 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:38.680806 29484 raft_consensus.cc:348] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "546b10a9a8c643f0aab44ce295f76187" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45723 } }
I20260806 04:50:38.681193 29484 raft_consensus.cc:374] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:38.681321 29484 raft_consensus.cc:729] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546b10a9a8c643f0aab44ce295f76187, State: Initialized, Role: FOLLOWER
I20260806 04:50:38.681932 29484 consensus_queue.cc:260] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "546b10a9a8c643f0aab44ce295f76187" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45723 } }
I20260806 04:50:38.682196 29484 raft_consensus.cc:388] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:38.682374 29484 raft_consensus.cc:482] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:38.682549 29484 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:38.684464 29487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:38.677605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:46213 (local address 127.0.0.1:45723)
0806 04:50:38.677780 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:38.677787 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:38.678300 (+ 513us) server_negotiation.cc:407] Connection header received
0806 04:50:38.678462 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:38.678467 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:38.678545 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:38.678652 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:38.679127 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:38.680310 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:38.681766 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:38.682300 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:38.682462 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:38.683655 (+ 1193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:38.683661 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:38.683676 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:38.683696 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:38.683750 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:38.683769 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:38.683912 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:38.684100 (+ 188us) server_negotiation.cc:299] Negotiation successful
0806 04:50:38.684154 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 04:50:38.685138 29484 raft_consensus.cc:504] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "546b10a9a8c643f0aab44ce295f76187" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45723 } }
I20260806 04:50:38.685674 29484 leader_election.cc:302] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 546b10a9a8c643f0aab44ce295f76187; no voters:
I20260806 04:50:38.686329 29484 leader_election.cc:288] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:38.686465 29494 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:38.687163 29494 raft_consensus.cc:686] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [term 1 LEADER]: Becoming Leader. State: Replica: 546b10a9a8c643f0aab44ce295f76187, State: Running, Role: LEADER
I20260806 04:50:38.687669 29494 consensus_queue.cc:237] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "546b10a9a8c643f0aab44ce295f76187" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45723 } }
I20260806 04:50:38.688391 29484 sys_catalog.cc:564] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:38.690366 29496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 546b10a9a8c643f0aab44ce295f76187. Latest consensus state: current_term: 1 leader_uuid: "546b10a9a8c643f0aab44ce295f76187" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "546b10a9a8c643f0aab44ce295f76187" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45723 } } }
I20260806 04:50:38.690814 29496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:38.691663 29499 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:38.693189 29495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "546b10a9a8c643f0aab44ce295f76187" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "546b10a9a8c643f0aab44ce295f76187" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45723 } } }
I20260806 04:50:38.694178 29495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:38.701781 29499 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:38.713577 29499 catalog_manager.cc:1347] Generated new cluster ID: 17b30dba868c4424b44e4458c3a87a56
I20260806 04:50:38.713716 29499 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:38.735734 29499 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:38.737042 29499 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:38.745539 29499 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 546b10a9a8c643f0aab44ce295f76187: Generated new TSK 0
I20260806 04:50:38.746361 29499 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:38.761559 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29416
W20260806 04:50:38.763096 29479 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.101:39105
W20260806 04:50:38.763907 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29416: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:50:38.764084 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 29416
W20260806 04:50:38.783699 29401 connection.cc:535] client connection to 127.0.0.1:45723 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45723): Connection reset by peer (error 104)
2026-08-06T04:50:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2013 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:38 dist-test-slave-0b58 krb5kdc[29515](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:38 dist-test-slave-0b58 krb5kdc[29515](info): set up 2 sockets
Aug 06 04:50:38 dist-test-slave-0b58 krb5kdc[29515](info): commencing operation
krb5kdc: starting...
W20260806 04:50:39.922823 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.004s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:40 dist-test-slave-0b58 krb5kdc[29515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 04:50:40.235373 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39707
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:40.570333 29528 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:40.570608 29528 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:40.570700 29528 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:40.577872 29528 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:40.577981 29528 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:40.578028 29528 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:40.578096 29528 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:40.578142 29528 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:40.588690 29528 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39707
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:40.590456 29528 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:40.591744 29528 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:40.603592 29534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:40.603606 29536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:40.604099 29533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:40.604436 29528 server_base.cc:1034] running on GCE node
I20260806 04:50:40.605141 29528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:40.606443 29528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:40.607678 29528 hybrid_clock.cc:648] HybridClock initialized: now 1785991840607642 us; error 48 us; skew 500 ppm
I20260806 04:50:40.608036 29528 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:40 dist-test-slave-0b58 krb5kdc[29515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991840, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:40.614027 29528 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 04:50:40.615573 29528 webserver.cc:460] Webserver started at http://127.0.0.1:37737/ using document root <none> and password file <none>
I20260806 04:50:40.616245 29528 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:40.616477 29528 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:40.616784 29528 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:40.619689 29528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "30ffa44438d648de922f732825d672d3"
format_stamp: "Formatted at 2026-08-06 04:50:40 on dist-test-slave-0b58"
server_key: "c13eb75ec305790994e7da3372078cb4"
server_key_iv: "b465dcd4b24547adcda2a1b45c3597d7"
server_key_version: "encryptionkey@0"
I20260806 04:50:40.620551 29528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "30ffa44438d648de922f732825d672d3"
format_stamp: "Formatted at 2026-08-06 04:50:40 on dist-test-slave-0b58"
server_key: "c13eb75ec305790994e7da3372078cb4"
server_key_iv: "b465dcd4b24547adcda2a1b45c3597d7"
server_key_version: "encryptionkey@0"
I20260806 04:50:40.625499 29528 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:50:40.628927 29543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:40.630121 29528 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:50:40.630317 29528 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "30ffa44438d648de922f732825d672d3"
format_stamp: "Formatted at 2026-08-06 04:50:40 on dist-test-slave-0b58"
server_key: "c13eb75ec305790994e7da3372078cb4"
server_key_iv: "b465dcd4b24547adcda2a1b45c3597d7"
server_key_version: "encryptionkey@0"
I20260806 04:50:40.630517 29528 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:40.636427 29528 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:40.640472 29528 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:40.640758 29528 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:40.659750 29528 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39707
I20260806 04:50:40.659830 29594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39707 every 8 connection(s)
I20260806 04:50:40.661190 29528 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:40.664763 29595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:40.665529 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 29528
I20260806 04:50:40.665719 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:40.666183 7623 external_mini_cluster.cc:1428] Setting key eb149d74e92f5323becdf019582da69e
I20260806 04:50:40.673846 29598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:40.667907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:34883 (local address 127.0.0.1:39707)
0806 04:50:40.668702 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:40.668713 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:40.668758 (+ 45us) server_negotiation.cc:407] Connection header received
0806 04:50:40.670564 (+ 1806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:40.670586 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:40.670912 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:40.671226 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:40.672300 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:40.672315 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:40.672327 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:40.672342 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:40.672400 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:40.672424 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:40.672584 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:40.672703 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 04:50:40.672908 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":372,"threads_started":1}
I20260806 04:50:40.677547 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:40.678025 29595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3: Bootstrap starting.
I20260806 04:50:40.681007 29595 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:40.682163 29595 log.cc:824] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:40.684518 29598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:40.681904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:35581 (local address 127.0.0.1:39707)
0806 04:50:40.682076 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:40.682082 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:40.682559 (+ 477us) server_negotiation.cc:407] Connection header received
0806 04:50:40.682737 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:40.682742 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:40.682811 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:40.682892 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:40.683877 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:40.683882 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:40.683886 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:40.683904 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:40.683945 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:40.683963 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:40.684080 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:40.684149 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 04:50:40.684206 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 04:50:40.685235 29595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3: No bootstrap required, opened a new log
I20260806 04:50:40.692950 29595 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ffa44438d648de922f732825d672d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39707 } }
I20260806 04:50:40.693396 29595 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:40.693506 29595 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30ffa44438d648de922f732825d672d3, State: Initialized, Role: FOLLOWER
I20260806 04:50:40.694101 29595 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ffa44438d648de922f732825d672d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39707 } }
I20260806 04:50:40.694337 29595 raft_consensus.cc:388] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:40.694492 29595 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:40.694661 29595 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:40.697000 29595 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ffa44438d648de922f732825d672d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39707 } }
I20260806 04:50:40.697497 29595 leader_election.cc:302] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30ffa44438d648de922f732825d672d3; no voters:
I20260806 04:50:40.698033 29595 leader_election.cc:288] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:40.698164 29605 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:40.698881 29605 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [term 1 LEADER]: Becoming Leader. State: Replica: 30ffa44438d648de922f732825d672d3, State: Running, Role: LEADER
I20260806 04:50:40.699410 29605 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ffa44438d648de922f732825d672d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39707 } }
I20260806 04:50:40.700031 29595 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:40.702467 29607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30ffa44438d648de922f732825d672d3. Latest consensus state: current_term: 1 leader_uuid: "30ffa44438d648de922f732825d672d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ffa44438d648de922f732825d672d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39707 } } }
I20260806 04:50:40.702342 29606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30ffa44438d648de922f732825d672d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ffa44438d648de922f732825d672d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39707 } } }
I20260806 04:50:40.702888 29607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:40.702936 29606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:40.704717 29615 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:40.709214 29615 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:40.717794 29615 catalog_manager.cc:1347] Generated new cluster ID: 857d373f026b4311afe591adb2ad296f
I20260806 04:50:40.717893 29615 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:40.743849 29615 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:40.744417 29615 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:40.754566 29615 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30ffa44438d648de922f732825d672d3: Generated new TSK 0
I20260806 04:50:40.755527 29615 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:40.766675 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29528
W20260806 04:50:40.767704 29590 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.101:34883
W20260806 04:50:40.768450 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29528: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:50:40.768599 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 29528
2026-08-06T04:50:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2002 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:40 dist-test-slave-0b58 krb5kdc[29626](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:40 dist-test-slave-0b58 krb5kdc[29626](info): set up 2 sockets
Aug 06 04:50:40 dist-test-slave-0b58 krb5kdc[29626](info): commencing operation
krb5kdc: starting...
W20260806 04:50:41.898864 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:42 dist-test-slave-0b58 krb5kdc[29626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:50:42.187945 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:43403
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:43403
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:42.523303 29639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:42.523561 29639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:42.523749 29639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:42.531038 29639 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:42.531158 29639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:42.531263 29639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:42.531415 29639 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:42.531500 29639 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:42.541179 29639 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:43403
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:43403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:42.542397 29639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:42.543998 29639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:42.556067 29647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:42.556102 29644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:42.556159 29645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:42.561604 29639 server_base.cc:1034] running on GCE node
I20260806 04:50:42.562314 29639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:42.563607 29639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:42.564812 29639 hybrid_clock.cc:648] HybridClock initialized: now 1785991842564771 us; error 30 us; skew 500 ppm
I20260806 04:50:42.565163 29639 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:42 dist-test-slave-0b58 krb5kdc[29626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991842, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:42.568324 29639 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:50:42.569806 29639 webserver.cc:460] Webserver started at http://127.7.113.254:45759/ using document root <none> and password file <none>
I20260806 04:50:42.570473 29639 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:42.570624 29639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:42.570966 29639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:42.573982 29639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "1091e84179db481788a20c99cbc4e456"
format_stamp: "Formatted at 2026-08-06 04:50:42 on dist-test-slave-0b58"
server_key: "1fc9e74d4db5650ad125a431d4f14273"
server_key_iv: "13546ee93fa867aa3cbc3f0707e4061f"
server_key_version: "encryptionkey@0"
I20260806 04:50:42.574788 29639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "1091e84179db481788a20c99cbc4e456"
format_stamp: "Formatted at 2026-08-06 04:50:42 on dist-test-slave-0b58"
server_key: "1fc9e74d4db5650ad125a431d4f14273"
server_key_iv: "13546ee93fa867aa3cbc3f0707e4061f"
server_key_version: "encryptionkey@0"
I20260806 04:50:42.580020 29639 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 04:50:42.583351 29654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:42.584692 29639 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260806 04:50:42.584884 29639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "1091e84179db481788a20c99cbc4e456"
format_stamp: "Formatted at 2026-08-06 04:50:42 on dist-test-slave-0b58"
server_key: "1fc9e74d4db5650ad125a431d4f14273"
server_key_iv: "13546ee93fa867aa3cbc3f0707e4061f"
server_key_version: "encryptionkey@0"
I20260806 04:50:42.585076 29639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:42.616786 29639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:42.620584 29639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:42.620859 29639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:42.639210 29639 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:43403
I20260806 04:50:42.639235 29705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:43403 every 8 connection(s)
I20260806 04:50:42.640525 29639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:42.643971 29706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:42.648545 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 29639
I20260806 04:50:42.648729 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:42.649163 7623 external_mini_cluster.cc:1428] Setting key 35e3cd67679f4f20fb0f8e1bfedb6859
I20260806 04:50:42.654686 29706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456: Bootstrap starting.
I20260806 04:50:42.658233 29706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:42.659407 29706 log.cc:824] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:42.662075 29706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456: No bootstrap required, opened a new log
Aug 06 04:50:42 dist-test-slave-0b58 krb5kdc[29626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:50:42.671545 29706 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1091e84179db481788a20c99cbc4e456" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43403 } }
I20260806 04:50:42.671792 29709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:42.650837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40249 (local address 127.7.113.254:43403)
0806 04:50:42.651680 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:42.651691 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:42.651734 (+ 43us) server_negotiation.cc:407] Connection header received
0806 04:50:42.653500 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:42.653521 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:42.653880 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:42.654172 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:42.655903 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:42.657275 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:42.659078 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:42.659779 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:42.660023 (+ 244us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:42.664553 (+ 4530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:42.664560 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:42.664575 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:42.664610 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:42.667757 (+ 3147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:42.668693 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:42.668699 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:42.668704 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:42.668883 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:42.669351 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:42.669354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:42.669356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:42.669863 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:42.670108 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:42.670554 (+ 446us) server_negotiation.cc:299] Negotiation successful
0806 04:50:42.670773 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":438,"threads_started":1}
I20260806 04:50:42.671926 29706 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:42.672026 29706 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1091e84179db481788a20c99cbc4e456, State: Initialized, Role: FOLLOWER
I20260806 04:50:42.672650 29706 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1091e84179db481788a20c99cbc4e456" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43403 } }
I20260806 04:50:42.672904 29706 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:42.673070 29706 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:42.673276 29706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:42.675858 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:42.676331 29706 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1091e84179db481788a20c99cbc4e456" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43403 } }
I20260806 04:50:42.676815 29706 leader_election.cc:302] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1091e84179db481788a20c99cbc4e456; no voters:
I20260806 04:50:42.677407 29706 leader_election.cc:288] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:42.677543 29711 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:42.679524 29706 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:42.681454 29711 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [term 1 LEADER]: Becoming Leader. State: Replica: 1091e84179db481788a20c99cbc4e456, State: Running, Role: LEADER
I20260806 04:50:42.682062 29711 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1091e84179db481788a20c99cbc4e456" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43403 } }
I20260806 04:50:42.685384 29713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1091e84179db481788a20c99cbc4e456. Latest consensus state: current_term: 1 leader_uuid: "1091e84179db481788a20c99cbc4e456" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1091e84179db481788a20c99cbc4e456" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43403 } } }
I20260806 04:50:42.685375 29712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1091e84179db481788a20c99cbc4e456" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1091e84179db481788a20c99cbc4e456" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 43403 } } }
I20260806 04:50:42.685874 29713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:42.685874 29712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:42.687562 29725 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:42.696002 29725 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:42.704530 29709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:42.682282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36177 (local address 127.7.113.254:43403)
0806 04:50:42.682444 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:42.682449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:42.682905 (+ 456us) server_negotiation.cc:407] Connection header received
0806 04:50:42.683091 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:42.683099 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:42.683195 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:42.683317 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:42.688625 (+ 5308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:42.689906 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:42.692386 (+ 2480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:42.693375 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:42.693536 (+ 161us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:42.697377 (+ 3841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:42.697384 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:42.697388 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:42.697425 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:42.701208 (+ 3783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:42.702055 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:42.702060 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:42.702063 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:42.702197 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:42.702640 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:42.702648 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:42.702653 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:42.703141 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:42.703451 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:42.703961 (+ 510us) server_negotiation.cc:299] Negotiation successful
0806 04:50:42.704132 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 04:50:42.708220 29725 catalog_manager.cc:1347] Generated new cluster ID: cdf6d27fc3774965b2d4c3e4c0630d18
I20260806 04:50:42.708339 29725 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:42.725710 29725 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:42.727494 29725 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:42.738421 29725 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1091e84179db481788a20c99cbc4e456: Generated new TSK 0
I20260806 04:50:42.739384 29725 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:42.745142 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29639
I20260806 04:50:42.746308 29701 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:42.835259 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 29639
W20260806 04:50:42.854606 29624 connection.cc:535] client connection to 127.7.113.254:43403 recv error: Network error: failed to read from TLS socket (remote: 127.7.113.254:43403): Connection reset by peer (error 104)
2026-08-06T04:50:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2064 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:42 dist-test-slave-0b58 krb5kdc[29738](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:42 dist-test-slave-0b58 krb5kdc[29738](info): set up 2 sockets
Aug 06 04:50:42 dist-test-slave-0b58 krb5kdc[29738](info): commencing operation
krb5kdc: starting...
W20260806 04:50:43.962913 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:44 dist-test-slave-0b58 krb5kdc[29738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:50:44.269665 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42679
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:33397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:42679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:44.602612 29752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:44.603075 29752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:44.603242 29752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:44.611184 29752 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:44.611287 29752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:44.611334 29752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:44.611394 29752 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:44.611440 29752 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:44.621243 29752 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:33397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:42679
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:42679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:44.622467 29752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:44.623684 29752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:44.635489 29760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:44.635421 29758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:44.635887 29757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:44.636582 29752 server_base.cc:1034] running on GCE node
I20260806 04:50:44.637243 29752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:44.638499 29752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:44.639735 29752 hybrid_clock.cc:648] HybridClock initialized: now 1785991844639689 us; error 61 us; skew 500 ppm
I20260806 04:50:44.640089 29752 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:44 dist-test-slave-0b58 krb5kdc[29738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991844, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:44.643141 29752 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:50:44.644568 29752 webserver.cc:460] Webserver started at http://127.7.113.254:46181/ using document root <none> and password file <none>
I20260806 04:50:44.645215 29752 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:44.645367 29752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:44.645668 29752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:44.648648 29752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "4dc52f5840ae4c42a6c9737f9644a958"
format_stamp: "Formatted at 2026-08-06 04:50:44 on dist-test-slave-0b58"
server_key: "e547f78ac454eff9edd764ae3225fb6a"
server_key_iv: "69a509573db41cce9df34ee4e7e1ef78"
server_key_version: "encryptionkey@0"
I20260806 04:50:44.649425 29752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "4dc52f5840ae4c42a6c9737f9644a958"
format_stamp: "Formatted at 2026-08-06 04:50:44 on dist-test-slave-0b58"
server_key: "e547f78ac454eff9edd764ae3225fb6a"
server_key_iv: "69a509573db41cce9df34ee4e7e1ef78"
server_key_version: "encryptionkey@0"
I20260806 04:50:44.654493 29752 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:50:44.657838 29767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:44.659054 29752 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 04:50:44.659233 29752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "4dc52f5840ae4c42a6c9737f9644a958"
format_stamp: "Formatted at 2026-08-06 04:50:44 on dist-test-slave-0b58"
server_key: "e547f78ac454eff9edd764ae3225fb6a"
server_key_iv: "69a509573db41cce9df34ee4e7e1ef78"
server_key_version: "encryptionkey@0"
I20260806 04:50:44.659432 29752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:44.689117 29752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:44.692951 29752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:44.693241 29752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:44.711930 29752 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:42679
I20260806 04:50:44.711953 29818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:42679 every 8 connection(s)
I20260806 04:50:44.713333 29752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:44.717090 29819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:44.717208 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 29752
I20260806 04:50:44.717402 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:44.717829 7623 external_mini_cluster.cc:1428] Setting key cf6ddda0ee7ec5d3c7fd4e84180fd140
I20260806 04:50:44.730923 29819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958: Bootstrap starting.
I20260806 04:50:44.731164 29822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:44.719541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46799 (local address 127.7.113.254:42679)
0806 04:50:44.720495 (+ 954us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:44.720508 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:44.720548 (+ 40us) server_negotiation.cc:407] Connection header received
0806 04:50:44.722046 (+ 1498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:44.722066 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:44.722453 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:44.722788 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:44.723419 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:44.724807 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:44.726653 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:44.727309 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:44.727446 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:44.728891 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:44.728899 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:44.728916 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:44.729458 (+ 542us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:44.729528 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:44.729552 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:44.729665 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:44.729969 (+ 304us) server_negotiation.cc:299] Negotiation successful
0806 04:50:44.730166 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":745,"thread_start_us":489,"threads_started":1}
I20260806 04:50:44.734509 29819 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:44.734907 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:44.735558 29819 log.cc:824] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:44.738468 29819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958: No bootstrap required, opened a new log
I20260806 04:50:44.745702 29822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:44.739448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59235 (local address 127.7.113.254:42679)
0806 04:50:44.739640 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:44.739648 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:44.740051 (+ 403us) server_negotiation.cc:407] Connection header received
0806 04:50:44.740293 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:44.740300 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:44.740381 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:44.740498 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:44.741000 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:44.741784 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:44.743106 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:44.743577 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:44.743730 (+ 153us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:44.744930 (+ 1200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:44.744938 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:44.744941 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:44.744959 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:44.744996 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:44.745011 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:44.745143 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:44.745349 (+ 206us) server_negotiation.cc:299] Negotiation successful
0806 04:50:44.745407 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 04:50:44.747015 29819 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc52f5840ae4c42a6c9737f9644a958" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42679 } }
I20260806 04:50:44.747493 29819 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:44.747601 29819 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dc52f5840ae4c42a6c9737f9644a958, State: Initialized, Role: FOLLOWER
I20260806 04:50:44.748217 29819 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc52f5840ae4c42a6c9737f9644a958" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42679 } }
I20260806 04:50:44.748570 29819 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:44.748745 29819 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:44.748944 29819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:44.751211 29819 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc52f5840ae4c42a6c9737f9644a958" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42679 } }
I20260806 04:50:44.751713 29819 leader_election.cc:302] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4dc52f5840ae4c42a6c9737f9644a958; no voters:
I20260806 04:50:44.752429 29819 leader_election.cc:288] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:44.752550 29829 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:44.753367 29829 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [term 1 LEADER]: Becoming Leader. State: Replica: 4dc52f5840ae4c42a6c9737f9644a958, State: Running, Role: LEADER
I20260806 04:50:44.754055 29829 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc52f5840ae4c42a6c9737f9644a958" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42679 } }
I20260806 04:50:44.755054 29819 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:44.757002 29830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4dc52f5840ae4c42a6c9737f9644a958. Latest consensus state: current_term: 1 leader_uuid: "4dc52f5840ae4c42a6c9737f9644a958" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc52f5840ae4c42a6c9737f9644a958" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42679 } } }
I20260806 04:50:44.757381 29830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:44.759001 29831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4dc52f5840ae4c42a6c9737f9644a958" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc52f5840ae4c42a6c9737f9644a958" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 42679 } } }
I20260806 04:50:44.759299 29831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:44.764401 29834 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:44.769496 29834 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:44.778138 29834 catalog_manager.cc:1347] Generated new cluster ID: f7b71a20e39d43288e3f639698ac43fc
I20260806 04:50:44.778345 29834 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:44.788715 29834 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:44.789924 29834 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:44.795607 29834 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4dc52f5840ae4c42a6c9737f9644a958: Generated new TSK 0
I20260806 04:50:44.796399 29834 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:44.802243 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29752
W20260806 04:50:44.803453 29814 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46799
W20260806 04:50:44.804246 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29752: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:50:44.804450 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 29752
W20260806 04:50:44.823575 29736 connection.cc:535] client connection to 127.7.113.254:42679 recv error: Network error: failed to read from TLS socket (remote: 127.7.113.254:42679): Connection reset by peer (error 104)
2026-08-06T04:50:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1969 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:44 dist-test-slave-0b58 krb5kdc[29850](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:44 dist-test-slave-0b58 krb5kdc[29850](info): set up 2 sockets
Aug 06 04:50:44 dist-test-slave-0b58 krb5kdc[29850](info): commencing operation
krb5kdc: starting...
W20260806 04:50:45.934854 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.003s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:46 dist-test-slave-0b58 krb5kdc[29850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:50:46.257259 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:36473
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:40517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:36473
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:46.586445 29863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:46.586759 29863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:46.586937 29863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:46.593863 29863 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:46.594002 29863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:46.594108 29863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:46.594219 29863 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:46.594319 29863 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:46.603714 29863 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:40517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:36473
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:36473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:46.604938 29863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:46.606236 29863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:46.618537 29869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:46.618620 29871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:46.618635 29868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:46.619222 29863 server_base.cc:1034] running on GCE node
I20260806 04:50:46.619956 29863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:46.621316 29863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:46.622550 29863 hybrid_clock.cc:648] HybridClock initialized: now 1785991846622496 us; error 41 us; skew 500 ppm
I20260806 04:50:46.622890 29863 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:46 dist-test-slave-0b58 krb5kdc[29850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991846, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:46.630977 29863 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:50:46.632496 29863 webserver.cc:460] Webserver started at http://127.7.113.254:42191/ using document root <none> and password file <none>
I20260806 04:50:46.633140 29863 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:46.633296 29863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:46.633600 29863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:46.636513 29863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "30dc8f22c0604630b446cfa5ffb88e48"
format_stamp: "Formatted at 2026-08-06 04:50:46 on dist-test-slave-0b58"
server_key: "f6eb1dc2d741d056a424e981fed6559b"
server_key_iv: "ecec99c1cda3bb3dc851d6eef5ce013b"
server_key_version: "encryptionkey@0"
I20260806 04:50:46.637303 29863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "30dc8f22c0604630b446cfa5ffb88e48"
format_stamp: "Formatted at 2026-08-06 04:50:46 on dist-test-slave-0b58"
server_key: "f6eb1dc2d741d056a424e981fed6559b"
server_key_iv: "ecec99c1cda3bb3dc851d6eef5ce013b"
server_key_version: "encryptionkey@0"
I20260806 04:50:46.642187 29863 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 04:50:46.645601 29878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:46.646778 29863 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 04:50:46.646956 29863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "30dc8f22c0604630b446cfa5ffb88e48"
format_stamp: "Formatted at 2026-08-06 04:50:46 on dist-test-slave-0b58"
server_key: "f6eb1dc2d741d056a424e981fed6559b"
server_key_iv: "ecec99c1cda3bb3dc851d6eef5ce013b"
server_key_version: "encryptionkey@0"
I20260806 04:50:46.647154 29863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:46.652778 29863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:46.656469 29863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:46.656757 29863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:46.675206 29863 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:36473
I20260806 04:50:46.675292 29929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:36473 every 8 connection(s)
I20260806 04:50:46.676571 29863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:46.679977 29930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:46.685550 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 29863
I20260806 04:50:46.685729 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:46.686324 7623 external_mini_cluster.cc:1428] Setting key dcc137e8fd6bfa7c8e0ec3abd4fc7fb1
I20260806 04:50:46.690923 29930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48: Bootstrap starting.
I20260806 04:50:46.693799 29933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:46.688114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34257 (local address 127.7.113.254:36473)
0806 04:50:46.688954 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:46.688964 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:46.689004 (+ 40us) server_negotiation.cc:407] Connection header received
0806 04:50:46.690575 (+ 1571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:46.690598 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:46.690886 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:46.691303 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:46.692340 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:46.692352 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:46.692367 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:46.692381 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:46.692442 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:46.692466 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:46.692713 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:46.692855 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 04:50:46.693035 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":379,"threads_started":1}
I20260806 04:50:46.694186 29930 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:46.695202 29930 log.cc:824] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:46.697331 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:46.697971 29930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48: No bootstrap required, opened a new log
I20260806 04:50:46.704078 29933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:46.701667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57191 (local address 127.7.113.254:36473)
0806 04:50:46.701862 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:46.701870 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:46.702134 (+ 264us) server_negotiation.cc:407] Connection header received
0806 04:50:46.702318 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:46.702323 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:46.702375 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:46.702485 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:46.703401 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:46.703410 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:46.703415 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:46.703442 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:46.703476 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:46.703490 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:46.703623 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:46.703755 (+ 132us) server_negotiation.cc:299] Negotiation successful
0806 04:50:46.703818 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 04:50:46.705941 29930 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30dc8f22c0604630b446cfa5ffb88e48" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 36473 } }
I20260806 04:50:46.706318 29930 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:46.706432 29930 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30dc8f22c0604630b446cfa5ffb88e48, State: Initialized, Role: FOLLOWER
I20260806 04:50:46.707141 29930 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30dc8f22c0604630b446cfa5ffb88e48" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 36473 } }
I20260806 04:50:46.707512 29930 raft_consensus.cc:388] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:46.707664 29930 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:46.707844 29930 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:46.710060 29930 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30dc8f22c0604630b446cfa5ffb88e48" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 36473 } }
I20260806 04:50:46.710563 29930 leader_election.cc:302] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30dc8f22c0604630b446cfa5ffb88e48; no voters:
I20260806 04:50:46.711150 29930 leader_election.cc:288] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:46.711275 29940 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:46.711961 29940 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [term 1 LEADER]: Becoming Leader. State: Replica: 30dc8f22c0604630b446cfa5ffb88e48, State: Running, Role: LEADER
I20260806 04:50:46.712548 29940 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30dc8f22c0604630b446cfa5ffb88e48" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 36473 } }
I20260806 04:50:46.713220 29930 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:46.716045 29941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30dc8f22c0604630b446cfa5ffb88e48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30dc8f22c0604630b446cfa5ffb88e48" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 36473 } } }
I20260806 04:50:46.716598 29941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:46.716275 29942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30dc8f22c0604630b446cfa5ffb88e48. Latest consensus state: current_term: 1 leader_uuid: "30dc8f22c0604630b446cfa5ffb88e48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30dc8f22c0604630b446cfa5ffb88e48" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 36473 } } }
I20260806 04:50:46.717317 29942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:46.721385 29949 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:46.726073 29949 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:46.734150 29949 catalog_manager.cc:1347] Generated new cluster ID: 19038055f525470d81442965a58e79f4
I20260806 04:50:46.734269 29949 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:46.756491 29949 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:46.756953 29949 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:46.764943 29949 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30dc8f22c0604630b446cfa5ffb88e48: Generated new TSK 0
I20260806 04:50:46.765867 29949 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:46.778548 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29863
W20260806 04:50:46.779668 29925 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:34257
W20260806 04:50:46.780478 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29863: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:50:46.780635 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 29863
2026-08-06T04:50:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1976 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:46 dist-test-slave-0b58 krb5kdc[29961](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:46 dist-test-slave-0b58 krb5kdc[29961](info): set up 2 sockets
Aug 06 04:50:46 dist-test-slave-0b58 krb5kdc[29961](info): commencing operation
krb5kdc: starting...
W20260806 04:50:47.919103 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:48 dist-test-slave-0b58 krb5kdc[29961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991848, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:50:48.231560 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:32811
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:46001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:32811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:48.568055 29974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:48.568441 29974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:48.568614 29974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:48.575836 29974 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:48.575934 29974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:48.576040 29974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:48.576133 29974 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:48.576205 29974 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:48.585932 29974 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:46001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:32811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:32811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:48.587262 29974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:48.588564 29974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:48.600359 29979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:48.600443 29980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:48.600405 29982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:48.601289 29974 server_base.cc:1034] running on GCE node
I20260806 04:50:48.602068 29974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:48.603444 29974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:48.604646 29974 hybrid_clock.cc:648] HybridClock initialized: now 1785991848604598 us; error 44 us; skew 500 ppm
I20260806 04:50:48.604985 29974 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:48 dist-test-slave-0b58 krb5kdc[29961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991848, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:48.608031 29974 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:50:48.609611 29974 webserver.cc:460] Webserver started at http://127.7.113.254:44781/ using document root <none> and password file <none>
I20260806 04:50:48.610255 29974 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:48.610390 29974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:48.610706 29974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:48.613648 29974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "dec952e8ddf04645af083277faa3bb43"
format_stamp: "Formatted at 2026-08-06 04:50:48 on dist-test-slave-0b58"
server_key: "7006c709642d0c7152415562d48cf95c"
server_key_iv: "0014074e68414181f9c0bcf4eb526d26"
server_key_version: "encryptionkey@0"
I20260806 04:50:48.614423 29974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "dec952e8ddf04645af083277faa3bb43"
format_stamp: "Formatted at 2026-08-06 04:50:48 on dist-test-slave-0b58"
server_key: "7006c709642d0c7152415562d48cf95c"
server_key_iv: "0014074e68414181f9c0bcf4eb526d26"
server_key_version: "encryptionkey@0"
I20260806 04:50:48.620532 29974 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 04:50:48.623903 29989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:48.625475 29974 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:50:48.625667 29974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "dec952e8ddf04645af083277faa3bb43"
format_stamp: "Formatted at 2026-08-06 04:50:48 on dist-test-slave-0b58"
server_key: "7006c709642d0c7152415562d48cf95c"
server_key_iv: "0014074e68414181f9c0bcf4eb526d26"
server_key_version: "encryptionkey@0"
I20260806 04:50:48.625869 29974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:48.646654 29974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:48.650712 29974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:48.651051 29974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:48.669881 29974 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:32811
I20260806 04:50:48.669893 30040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:32811 every 8 connection(s)
I20260806 04:50:48.671273 29974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:48.674938 30041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:48.680071 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 29974
I20260806 04:50:48.680306 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:48.680796 7623 external_mini_cluster.cc:1428] Setting key 5a2ced234e07265b786b7f48fea6d376
I20260806 04:50:48.685559 30041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43: Bootstrap starting.
I20260806 04:50:48.689316 30041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:48.690543 30041 log.cc:824] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:48.693977 30041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43: No bootstrap required, opened a new log
Aug 06 04:50:48 dist-test-slave-0b58 krb5kdc[29961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991848, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:50:48.704586 30041 raft_consensus.cc:348] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dec952e8ddf04645af083277faa3bb43" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 32811 } }
I20260806 04:50:48.705130 30041 raft_consensus.cc:374] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:48.705245 30041 raft_consensus.cc:729] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec952e8ddf04645af083277faa3bb43, State: Initialized, Role: FOLLOWER
I20260806 04:50:48.705679 30044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:48.682522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42001 (local address 127.7.113.254:32811)
0806 04:50:48.683362 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:48.683373 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:48.683415 (+ 42us) server_negotiation.cc:407] Connection header received
0806 04:50:48.685122 (+ 1707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:48.685144 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:48.685514 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:48.685866 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:48.687743 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:48.689102 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:48.690970 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:48.692094 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:48.692227 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:48.697088 (+ 4861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:48.697103 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:48.697121 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:48.697169 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:48.701216 (+ 4047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:48.701902 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:48.701911 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:48.701920 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:48.702144 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:48.702526 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:48.702531 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:48.702535 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:48.703231 (+ 696us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:48.703552 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:48.703847 (+ 295us) server_negotiation.cc:299] Negotiation successful
0806 04:50:48.704294 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":394,"threads_started":1}
I20260806 04:50:48.705927 30041 consensus_queue.cc:260] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dec952e8ddf04645af083277faa3bb43" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 32811 } }
I20260806 04:50:48.706241 30041 raft_consensus.cc:388] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:48.706403 30041 raft_consensus.cc:482] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:48.706593 30041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:48.709116 30041 raft_consensus.cc:504] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dec952e8ddf04645af083277faa3bb43" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 32811 } }
I20260806 04:50:48.709524 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:48.709676 30041 leader_election.cc:302] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dec952e8ddf04645af083277faa3bb43; no voters:
I20260806 04:50:48.710278 30041 leader_election.cc:288] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:48.710386 30046 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:48.712383 30041 sys_catalog.cc:564] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:48.712739 30046 raft_consensus.cc:686] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [term 1 LEADER]: Becoming Leader. State: Replica: dec952e8ddf04645af083277faa3bb43, State: Running, Role: LEADER
I20260806 04:50:48.713292 30046 consensus_queue.cc:237] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dec952e8ddf04645af083277faa3bb43" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 32811 } }
I20260806 04:50:48.715991 30047 sys_catalog.cc:455] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dec952e8ddf04645af083277faa3bb43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dec952e8ddf04645af083277faa3bb43" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 32811 } } }
I20260806 04:50:48.716473 30048 sys_catalog.cc:455] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dec952e8ddf04645af083277faa3bb43. Latest consensus state: current_term: 1 leader_uuid: "dec952e8ddf04645af083277faa3bb43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dec952e8ddf04645af083277faa3bb43" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 32811 } } }
I20260806 04:50:48.716707 30048 sys_catalog.cc:458] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:48.717067 30047 sys_catalog.cc:458] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43 [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:48.717526 30056 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:48.732713 30056 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:48.756876 30056 catalog_manager.cc:1347] Generated new cluster ID: 2e9f1d517f454eb884f27e04354917b7
I20260806 04:50:48.757107 30056 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:48.757228 30044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:48.733623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33231 (local address 127.7.113.254:32811)
0806 04:50:48.733855 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:48.733862 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:48.736902 (+ 3040us) server_negotiation.cc:407] Connection header received
0806 04:50:48.737114 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:48.737119 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:48.737208 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:48.737332 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:48.740038 (+ 2706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:48.741587 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:48.743909 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:48.744881 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:48.745009 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:48.749152 (+ 4143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:48.749162 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:48.749170 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:48.749221 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:48.753788 (+ 4567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:48.754665 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:48.754671 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:48.754675 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:48.754864 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:48.755332 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:48.755337 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:48.755341 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:48.755800 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:48.756078 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:48.756483 (+ 405us) server_negotiation.cc:299] Negotiation successful
0806 04:50:48.756741 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 04:50:48.757485 30069 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 04:50:48.769060 30056 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:48.770278 30056 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:48.775769 30056 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dec952e8ddf04645af083277faa3bb43: Generated new TSK 0
I20260806 04:50:48.776605 30056 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:48.783262 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 29974
I20260806 04:50:48.784584 30036 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:48.873982 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 29974
2026-08-06T04:50:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2090 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:48 dist-test-slave-0b58 krb5kdc[30073](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:48 dist-test-slave-0b58 krb5kdc[30073](info): set up 2 sockets
Aug 06 04:50:48 dist-test-slave-0b58 krb5kdc[30073](info): commencing operation
krb5kdc: starting...
W20260806 04:50:50.004987 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.003s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:50 dist-test-slave-0b58 krb5kdc[30073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:50:50.320226 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:35777
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:38907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:35777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:50.656281 30086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:50.656543 30086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:50.656684 30086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:50.663805 30086 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:50.663919 30086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:50.663965 30086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:50.664048 30086 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:50.664129 30086 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:50.673925 30086 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:38907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:35777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:35777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:50.675143 30086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:50.676458 30086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:50.688392 30091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:50.688413 30092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:50.688418 30094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:50.689396 30086 server_base.cc:1034] running on GCE node
I20260806 04:50:50.690130 30086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:50.691406 30086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:50.692598 30086 hybrid_clock.cc:648] HybridClock initialized: now 1785991850692540 us; error 48 us; skew 500 ppm
I20260806 04:50:50.692929 30086 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:50 dist-test-slave-0b58 krb5kdc[30073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991850, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:50.695863 30086 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:50:50.697188 30086 webserver.cc:460] Webserver started at http://127.7.113.254:39171/ using document root <none> and password file <none>
I20260806 04:50:50.697835 30086 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:50.697963 30086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:50.698258 30086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:50.701188 30086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "1842961389d3438d87f1e47df40b2acc"
format_stamp: "Formatted at 2026-08-06 04:50:50 on dist-test-slave-0b58"
server_key: "e5a0b847556cd1af13f4bea9fae23864"
server_key_iv: "6d1eb01d644cba3e1daee3e6bb5d5415"
server_key_version: "encryptionkey@0"
I20260806 04:50:50.701941 30086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "1842961389d3438d87f1e47df40b2acc"
format_stamp: "Formatted at 2026-08-06 04:50:50 on dist-test-slave-0b58"
server_key: "e5a0b847556cd1af13f4bea9fae23864"
server_key_iv: "6d1eb01d644cba3e1daee3e6bb5d5415"
server_key_version: "encryptionkey@0"
I20260806 04:50:50.706862 30086 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 04:50:50.710250 30101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:50.711508 30086 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 04:50:50.711687 30086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "1842961389d3438d87f1e47df40b2acc"
format_stamp: "Formatted at 2026-08-06 04:50:50 on dist-test-slave-0b58"
server_key: "e5a0b847556cd1af13f4bea9fae23864"
server_key_iv: "6d1eb01d644cba3e1daee3e6bb5d5415"
server_key_version: "encryptionkey@0"
I20260806 04:50:50.711887 30086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:50.738375 30086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:50.742203 30086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:50.742497 30086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:50.760800 30086 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:35777
I20260806 04:50:50.760831 30153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:35777 every 8 connection(s)
I20260806 04:50:50.762143 30086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:50.765878 30154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:50.771468 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 30086
I20260806 04:50:50.771651 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:50.772284 7623 external_mini_cluster.cc:1428] Setting key cf8a926d7f46fb8539de9483d0c8124e
I20260806 04:50:50.777118 30154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc: Bootstrap starting.
I20260806 04:50:50.780164 30154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:50.781152 30154 log.cc:824] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:50.784487 30154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc: No bootstrap required, opened a new log
I20260806 04:50:50.785929 30157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:50.774307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53581 (local address 127.7.113.254:35777)
0806 04:50:50.775117 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:50.775129 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:50.775176 (+ 47us) server_negotiation.cc:407] Connection header received
0806 04:50:50.776885 (+ 1709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:50.776907 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:50.777339 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:50.777701 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:50.778232 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:50.779534 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:50.780894 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:50.781891 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:50.782098 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:50.783184 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:50.783195 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:50.783214 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:50.783924 (+ 710us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:50.784023 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:50.784054 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:50.784175 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:50.784364 (+ 189us) server_negotiation.cc:299] Negotiation successful
0806 04:50:50.784624 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":371,"threads_started":1}
I20260806 04:50:50.789783 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:50.795068 30154 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1842961389d3438d87f1e47df40b2acc" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35777 } }
I20260806 04:50:50.795497 30154 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:50.795624 30154 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1842961389d3438d87f1e47df40b2acc, State: Initialized, Role: FOLLOWER
I20260806 04:50:50.796284 30154 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1842961389d3438d87f1e47df40b2acc" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35777 } }
I20260806 04:50:50.796569 30154 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:50.796727 30154 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:50.796908 30154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:50.799654 30154 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1842961389d3438d87f1e47df40b2acc" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35777 } }
I20260806 04:50:50.800213 30154 leader_election.cc:302] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1842961389d3438d87f1e47df40b2acc; no voters:
I20260806 04:50:50.800907 30154 leader_election.cc:288] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:50.801008 30164 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:50.801874 30157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:50.794999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56407 (local address 127.7.113.254:35777)
0806 04:50:50.795178 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:50.795184 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:50.795593 (+ 409us) server_negotiation.cc:407] Connection header received
0806 04:50:50.795802 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:50.795807 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:50.795877 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:50.795972 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:50.796547 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:50.797635 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:50.798899 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:50.799607 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:50.799759 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:50.800941 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:50.800948 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:50.800952 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:50.800974 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:50.801026 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:50.801047 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:50.801136 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:50.801360 (+ 224us) server_negotiation.cc:299] Negotiation successful
0806 04:50:50.801475 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 04:50:50.802800 30164 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [term 1 LEADER]: Becoming Leader. State: Replica: 1842961389d3438d87f1e47df40b2acc, State: Running, Role: LEADER
I20260806 04:50:50.803355 30164 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1842961389d3438d87f1e47df40b2acc" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35777 } }
I20260806 04:50:50.805276 30165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1842961389d3438d87f1e47df40b2acc. Latest consensus state: current_term: 1 leader_uuid: "1842961389d3438d87f1e47df40b2acc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1842961389d3438d87f1e47df40b2acc" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35777 } } }
I20260806 04:50:50.805754 30165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:50.806073 30166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1842961389d3438d87f1e47df40b2acc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1842961389d3438d87f1e47df40b2acc" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35777 } } }
I20260806 04:50:50.806298 30154 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:50.806402 30166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:50.816112 30168 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:50.820472 30168 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:50.828294 30168 catalog_manager.cc:1347] Generated new cluster ID: 2b3cd0cc84274ac794316bd4521c06d6
I20260806 04:50:50.828402 30168 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:50.844650 30168 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:50.845860 30168 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:50.856583 30168 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1842961389d3438d87f1e47df40b2acc: Generated new TSK 0
I20260806 04:50:50.857344 30168 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:50.865726 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 30086
W20260806 04:50:50.866981 30149 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53581
W20260806 04:50:50.867687 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 30086: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:50:50.867833 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 30086
2026-08-06T04:50:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1995 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:50 dist-test-slave-0b58 krb5kdc[30185](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:50 dist-test-slave-0b58 krb5kdc[30185](info): set up 2 sockets
Aug 06 04:50:50 dist-test-slave-0b58 krb5kdc[30185](info): commencing operation
krb5kdc: starting...
W20260806 04:50:51.994890 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:52 dist-test-slave-0b58 krb5kdc[30185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:50:52.317668 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:45233
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:36653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:45233
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:52.653316 30198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:52.653599 30198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:52.653702 30198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:52.661002 30198 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:52.661113 30198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:52.661175 30198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:52.661235 30198 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:52.661280 30198 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:52.670997 30198 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:36653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:45233
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:45233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:52.672173 30198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:52.673439 30198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:52.685186 30203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:52.685186 30204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:52.685236 30206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:52.686332 30198 server_base.cc:1034] running on GCE node
I20260806 04:50:52.687096 30198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:52.688410 30198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:52.689606 30198 hybrid_clock.cc:648] HybridClock initialized: now 1785991852689556 us; error 46 us; skew 500 ppm
I20260806 04:50:52.689937 30198 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:52 dist-test-slave-0b58 krb5kdc[30185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991852, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:52.698028 30198 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:50:52.699441 30198 webserver.cc:460] Webserver started at http://127.7.113.254:41093/ using document root <none> and password file <none>
I20260806 04:50:52.700079 30198 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:52.700209 30198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:52.700541 30198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:52.703429 30198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "6af52baddc3c42dcb8a448eba771687c"
format_stamp: "Formatted at 2026-08-06 04:50:52 on dist-test-slave-0b58"
server_key: "432c2f7f62dfd2ffc177e8561cb2cd9a"
server_key_iv: "dfc96302f8bf64253a927a0d7b7bdb43"
server_key_version: "encryptionkey@0"
I20260806 04:50:52.704185 30198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "6af52baddc3c42dcb8a448eba771687c"
format_stamp: "Formatted at 2026-08-06 04:50:52 on dist-test-slave-0b58"
server_key: "432c2f7f62dfd2ffc177e8561cb2cd9a"
server_key_iv: "dfc96302f8bf64253a927a0d7b7bdb43"
server_key_version: "encryptionkey@0"
I20260806 04:50:52.709177 30198 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260806 04:50:52.712488 30213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:52.713691 30198 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:50:52.713871 30198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "6af52baddc3c42dcb8a448eba771687c"
format_stamp: "Formatted at 2026-08-06 04:50:52 on dist-test-slave-0b58"
server_key: "432c2f7f62dfd2ffc177e8561cb2cd9a"
server_key_iv: "dfc96302f8bf64253a927a0d7b7bdb43"
server_key_version: "encryptionkey@0"
I20260806 04:50:52.714063 30198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:52.719548 30198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:52.723656 30198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:52.723961 30198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:52.742499 30198 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:45233
I20260806 04:50:52.742535 30264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:45233 every 8 connection(s)
I20260806 04:50:52.743799 30198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:52.747401 30265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:52.748171 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 30198
I20260806 04:50:52.748361 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:52.748783 7623 external_mini_cluster.cc:1428] Setting key 6906055548f5f8d5eb5dc27c3698e7b0
I20260806 04:50:52.756592 30269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:52.750452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55851 (local address 127.7.113.254:45233)
0806 04:50:52.751277 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:52.751288 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:52.751331 (+ 43us) server_negotiation.cc:407] Connection header received
0806 04:50:52.753302 (+ 1971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:52.753325 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:52.753651 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:52.753978 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:52.755023 (+ 1045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:52.755029 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:52.755043 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:52.755057 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:52.755113 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:52.755136 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:52.755299 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:52.755439 (+ 140us) server_negotiation.cc:299] Negotiation successful
0806 04:50:52.755647 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":371,"threads_started":1}
I20260806 04:50:52.760051 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:52.760222 30265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c: Bootstrap starting.
I20260806 04:50:52.764009 30265 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:52.765333 30265 log.cc:824] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:52.767835 30269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:52.765396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36705 (local address 127.7.113.254:45233)
0806 04:50:52.765612 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:52.765620 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:52.766038 (+ 418us) server_negotiation.cc:407] Connection header received
0806 04:50:52.766205 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:52.766212 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:52.766274 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:52.766399 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:52.767204 (+ 805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:52.767208 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:52.767211 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 04:50:52.767224 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:52.767260 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 04:50:52.767274 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:52.767358 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:52.767496 (+ 138us) server_negotiation.cc:299] Negotiation successful
0806 04:50:52.767540 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 04:50:52.768595 30265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c: No bootstrap required, opened a new log
I20260806 04:50:52.775645 30265 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6af52baddc3c42dcb8a448eba771687c" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45233 } }
I20260806 04:50:52.776021 30265 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 04:50:52.776122 30265 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6af52baddc3c42dcb8a448eba771687c, State: Initialized, Role: FOLLOWER
I20260806 04:50:52.776770 30265 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6af52baddc3c42dcb8a448eba771687c" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45233 } }
I20260806 04:50:52.777022 30265 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 04:50:52.777175 30265 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 04:50:52.777349 30265 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:52.779408 30265 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6af52baddc3c42dcb8a448eba771687c" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45233 } }
I20260806 04:50:52.779881 30265 leader_election.cc:302] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6af52baddc3c42dcb8a448eba771687c; no voters:
I20260806 04:50:52.780537 30265 leader_election.cc:288] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 04:50:52.780661 30276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:52.781364 30276 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [term 1 LEADER]: Becoming Leader. State: Replica: 6af52baddc3c42dcb8a448eba771687c, State: Running, Role: LEADER
I20260806 04:50:52.781914 30276 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6af52baddc3c42dcb8a448eba771687c" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45233 } }
I20260806 04:50:52.782637 30265 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:52.784822 30277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6af52baddc3c42dcb8a448eba771687c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6af52baddc3c42dcb8a448eba771687c" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45233 } } }
I20260806 04:50:52.785240 30277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:52.785739 30278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6af52baddc3c42dcb8a448eba771687c. Latest consensus state: current_term: 1 leader_uuid: "6af52baddc3c42dcb8a448eba771687c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6af52baddc3c42dcb8a448eba771687c" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 45233 } } }
I20260806 04:50:52.786252 30278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:52.786391 30283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:52.793076 30283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 04:50:52.802202 30283 catalog_manager.cc:1347] Generated new cluster ID: 1816b30be3c34ba28baf945d75aa0e66
I20260806 04:50:52.802322 30283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:52.811146 30283 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:52.811527 30283 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:52.819378 30283 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6af52baddc3c42dcb8a448eba771687c: Generated new TSK 0
I20260806 04:50:52.820699 30283 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:52.830420 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 30198
W20260806 04:50:52.840618 30260 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55851
W20260806 04:50:52.841462 7623 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 30198: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 04:50:52.841675 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 30198
2026-08-06T04:50:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1974 ms)
[----------] 18 tests from AuthTokenIssuingTest (36038 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:52 dist-test-slave-0b58 krb5kdc[30297](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:52 dist-test-slave-0b58 krb5kdc[30297](info): set up 2 sockets
Aug 06 04:50:52 dist-test-slave-0b58 krb5kdc[30297](info): commencing operation
krb5kdc: starting...
W20260806 04:50:53.954746 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.005s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:54 dist-test-slave-0b58 krb5kdc[30297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:50:54.272250 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:35655
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:43889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:35655,127.7.113.253:35389,127.7.113.252:44183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:54.605257 30311 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 04:50:54.605602 30311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:54.605752 30311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:54.605890 30311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:54.612972 30311 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:54.613080 30311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:54.613186 30311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:54.613269 30311 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:54.613359 30311 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:54.622700 30311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:43889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:35655,127.7.113.253:35389,127.7.113.252:44183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:35655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:54.623956 30311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:54.625231 30311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:54.636786 30316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:54.636740 30317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:54.636827 30319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:54.637694 30311 server_base.cc:1034] running on GCE node
I20260806 04:50:54.638438 30311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:54.640378 30311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:54.641667 30311 hybrid_clock.cc:648] HybridClock initialized: now 1785991854641584 us; error 41 us; skew 500 ppm
I20260806 04:50:54.642105 30311 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:54 dist-test-slave-0b58 krb5kdc[30297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991854, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:54.645285 30311 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:50:54.646742 30311 webserver.cc:460] Webserver started at http://127.7.113.254:37453/ using document root <none> and password file <none>
I20260806 04:50:54.647406 30311 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:54.647531 30311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:54.647843 30311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:54.650784 30311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d"
format_stamp: "Formatted at 2026-08-06 04:50:54 on dist-test-slave-0b58"
server_key: "cd03f3ab341eaab9c396023bb41cc9ba"
server_key_iv: "b42a059367d298b96afc62adda47bda9"
server_key_version: "encryptionkey@0"
I20260806 04:50:54.651558 30311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d"
format_stamp: "Formatted at 2026-08-06 04:50:54 on dist-test-slave-0b58"
server_key: "cd03f3ab341eaab9c396023bb41cc9ba"
server_key_iv: "b42a059367d298b96afc62adda47bda9"
server_key_version: "encryptionkey@0"
I20260806 04:50:54.656606 30311 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260806 04:50:54.659888 30326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:54.661293 30311 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:50:54.661471 30311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d"
format_stamp: "Formatted at 2026-08-06 04:50:54 on dist-test-slave-0b58"
server_key: "cd03f3ab341eaab9c396023bb41cc9ba"
server_key_iv: "b42a059367d298b96afc62adda47bda9"
server_key_version: "encryptionkey@0"
I20260806 04:50:54.661686 30311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:54.677666 30311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:54.681915 30311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:54.682194 30311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:54.700588 30311 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:35655
I20260806 04:50:54.700609 30377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:35655 every 8 connection(s)
I20260806 04:50:54.701886 30311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:54.705375 30378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:54.711776 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 30311
I20260806 04:50:54.712023 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:54.711799 30378 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } has no permanent_uuid. Determining permanent_uuid...
I20260806 04:50:54.712852 7623 external_mini_cluster.cc:1428] Setting key e729d9811e348093e9bc28119e36e390
Aug 06 04:50:54 dist-test-slave-0b58 krb5kdc[30297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991854, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:50:54.735569 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:54.715569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:35655 (local address 127.0.0.1:41730)
0806 04:50:54.716401 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:54.716451 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:54.718250 (+ 1799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:54.719397 (+ 1147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:54.719403 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:54.720081 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:54.720485 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:54.720504 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:54.722004 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:54.722009 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:54.723040 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:54.723052 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:54.723932 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:54.723939 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:54.724116 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:54.724806 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:54.724827 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:54.727368 (+ 2541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:54.731692 (+ 4324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:54.731702 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:54.731709 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:54.732091 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:54.732587 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:54.732590 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:54.732593 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:54.732737 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:54.733700 (+ 963us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:54.733710 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:54.734038 (+ 328us) client_negotiation.cc:769] Sending connection context
0806 04:50:54.734265 (+ 227us) client_negotiation.cc:240] Negotiation successful
0806 04:50:54.734604 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":368,"threads_started":1}
I20260806 04:50:54.735597 30381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:54.715568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41730 (local address 127.7.113.254:35655)
0806 04:50:54.718828 (+ 3260us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:54.718833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:54.718859 (+ 26us) server_negotiation.cc:407] Connection header received
0806 04:50:54.718981 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:54.718986 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:54.719178 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:54.719368 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:54.720686 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:54.721834 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:54.723183 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:54.723705 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:54.723914 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:54.727605 (+ 3691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:54.727616 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:54.727634 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:54.727681 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:54.731551 (+ 3870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:54.732233 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:54.732244 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:54.732249 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:54.732475 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:54.732860 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:54.732876 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:54.732881 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:54.733529 (+ 648us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:54.733723 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:54.734474 (+ 751us) server_negotiation.cc:299] Negotiation successful
0806 04:50:54.734768 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3112,"thread_start_us":2952,"threads_started":1}
I20260806 04:50:54.738271 30378 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } has no permanent_uuid. Determining permanent_uuid...
I20260806 04:50:54.739317 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:54.738940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:35389 (local address 127.0.0.1:51178)
0806 04:50:54.739099 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:54.739211 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 04:50:54.739604 30329 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
I20260806 04:50:54.741119 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:54.740796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:35389 (local address 127.0.0.1:51190)
0806 04:50:54.740940 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:54.740998 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 04:50:54.741328 30378 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:35389: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.7.113.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.253.keytab.
Entry for principal kudu/127.7.113.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.253.keytab.
I20260806 04:50:54.784350 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.253:35389
--webserver_interface=127.7.113.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.253.keytab
--principal=kudu/127.7.113.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:43889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:35655,127.7.113.253:35389,127.7.113.252:44183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:50:54.790629 30378 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } attempt: 1
I20260806 04:50:54.791821 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:54.791351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:35389 (local address 127.0.0.1:51204)
0806 04:50:54.791543 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:54.791662 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 04:50:54.792855 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:54.792507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:35389 (local address 127.0.0.1:51216)
0806 04:50:54.792661 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:54.792728 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 04:50:54.793045 30378 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:35389: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
I20260806 04:50:54.861311 30378 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } attempt: 2
I20260806 04:50:54.862689 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:54.862063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:35389 (local address 127.0.0.1:51220)
0806 04:50:54.862345 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:54.862491 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260806 04:50:54.863763 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:54.863310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:35389 (local address 127.0.0.1:51226)
0806 04:50:54.863474 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:54.863575 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 04:50:54.864059 30378 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:35389: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
I20260806 04:50:54.955363 30378 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } attempt: 3
I20260806 04:50:54.956665 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:54.956068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:35389 (local address 127.0.0.1:51240)
0806 04:50:54.956366 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:54.956508 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260806 04:50:54.957754 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:54.957367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:35389 (local address 127.0.0.1:51250)
0806 04:50:54.957509 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:54.957588 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 04:50:54.957950 30378 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:35389: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
I20260806 04:50:55.101224 30378 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } attempt: 4
I20260806 04:50:55.102617 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.101884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:35389 (local address 127.0.0.1:51262)
0806 04:50:55.102272 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.102397 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181}
I20260806 04:50:55.103741 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.103420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:35389 (local address 127.0.0.1:51266)
0806 04:50:55.103546 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.103629 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 04:50:55.103950 30378 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:35389: Network error: Client connection negotiation failed: client connection to 127.7.113.253:35389: connect: Connection refused (error 111)
W20260806 04:50:55.110252 30385 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 04:50:55.110574 30385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:55.110669 30385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:55.110801 30385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:55.118033 30385 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:55.118108 30385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:55.118306 30385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:55.118456 30385 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:55.118584 30385 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:55.128166 30385 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:43889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:35655,127.7.113.253:35389,127.7.113.252:44183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.253.keytab
--principal=kudu/127.7.113.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.253:35389
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.113.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:55.129419 30385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:55.130692 30385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:55.142011 30390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:55.141971 30391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:55.142097 30393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:55.143142 30385 server_base.cc:1034] running on GCE node
I20260806 04:50:55.143929 30385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:55.145330 30385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:55.146580 30385 hybrid_clock.cc:648] HybridClock initialized: now 1785991855146501 us; error 51 us; skew 500 ppm
I20260806 04:50:55.146883 30385 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:55 dist-test-slave-0b58 krb5kdc[30297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991855, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:55.150072 30385 init.cc:377] Logged in from keytab as kudu/127.7.113.253@KRBTEST.COM (short username kudu)
I20260806 04:50:55.151571 30385 webserver.cc:460] Webserver started at http://127.7.113.253:43189/ using document root <none> and password file <none>
I20260806 04:50:55.152163 30385 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:55.152305 30385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:55.152601 30385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:55.155336 30385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/data/instance:
uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5"
format_stamp: "Formatted at 2026-08-06 04:50:55 on dist-test-slave-0b58"
server_key: "4382f4fa9f9fba4845df288af6badf52"
server_key_iv: "90fa5a4869c0ae4cfaca8e02df271408"
server_key_version: "encryptionkey@0"
I20260806 04:50:55.156031 30385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/wal/instance:
uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5"
format_stamp: "Formatted at 2026-08-06 04:50:55 on dist-test-slave-0b58"
server_key: "4382f4fa9f9fba4845df288af6badf52"
server_key_iv: "90fa5a4869c0ae4cfaca8e02df271408"
server_key_version: "encryptionkey@0"
I20260806 04:50:55.160902 30385 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260806 04:50:55.164103 30400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:55.165488 30385 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:50:55.165683 30385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/wal
uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5"
format_stamp: "Formatted at 2026-08-06 04:50:55 on dist-test-slave-0b58"
server_key: "4382f4fa9f9fba4845df288af6badf52"
server_key_iv: "90fa5a4869c0ae4cfaca8e02df271408"
server_key_version: "encryptionkey@0"
I20260806 04:50:55.165915 30385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:55.192991 30385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:55.197257 30385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:55.197479 30385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:55.215672 30385 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.253:35389
I20260806 04:50:55.215695 30452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.253:35389 every 8 connection(s)
I20260806 04:50:55.217008 30385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/data/info.pb
I20260806 04:50:55.220671 30453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:55.222958 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 30385
I20260806 04:50:55.223146 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-1/wal/instance
I20260806 04:50:55.223737 7623 external_mini_cluster.cc:1428] Setting key 69a8ded0b5b590626ff502a0dc90f578
I20260806 04:50:55.229832 30453 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:50:55 dist-test-slave-0b58 krb5kdc[30297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991855, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.253@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:50:55.251334 30381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.233147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41732 (local address 127.7.113.254:35655)
0806 04:50:55.233360 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:55.233367 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:55.234618 (+ 1251us) server_negotiation.cc:407] Connection header received
0806 04:50:55.236488 (+ 1870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:55.236497 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:55.236595 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:55.236721 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:55.238136 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.238840 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.240355 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.240773 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.240908 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.244282 (+ 3374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:55.244294 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:55.244302 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:55.244357 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:55.248193 (+ 3836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.248891 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.248900 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.248905 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.249064 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.249454 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.249462 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.249468 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.249870 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:55.250017 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:55.250677 (+ 660us) server_negotiation.cc:299] Negotiation successful
0806 04:50:55.250928 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 04:50:55.251907 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.233670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:35655 (local address 127.0.0.1:41732)
0806 04:50:55.234439 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.234492 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:55.236181 (+ 1689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:55.236901 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:55.236908 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:55.237411 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:55.237959 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.237975 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.239003 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.239007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.240178 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.240192 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.240998 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.241005 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.241239 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.241888 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:55.241910 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:55.244030 (+ 2120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:55.248342 (+ 4312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.248349 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.248360 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.248765 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.249172 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.249175 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.249177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.249348 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.249990 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:55.249995 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:55.250309 (+ 314us) client_negotiation.cc:769] Sending connection context
0806 04:50:55.250523 (+ 214us) client_negotiation.cc:240] Negotiation successful
0806 04:50:55.250872 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":340,"threads_started":1}
I20260806 04:50:55.253667 30453 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.7.113.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.252@KRBTEST.COM" created.
Aug 06 04:50:55 dist-test-slave-0b58 krb5kdc[30297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991855, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.253@KRBTEST.COM for kudu/127.7.113.253@KRBTEST.COM
I20260806 04:50:55.268957 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.254467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:35389 (local address 127.0.0.1:51272)
0806 04:50:55.254613 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.254628 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:55.254702 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:55.255791 (+ 1089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:55.255795 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:55.256194 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:55.256361 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.256371 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.257707 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.257713 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.258562 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.258572 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.259408 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.259413 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.259571 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.260125 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:55.260146 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:55.262495 (+ 2349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:55.266621 (+ 4126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.266625 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.266628 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.267005 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.267412 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.267415 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.267417 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.267549 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.268214 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:55.268217 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:55.268361 (+ 144us) client_negotiation.cc:769] Sending connection context
0806 04:50:55.268460 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 04:50:55.268661 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260806 04:50:55.269382 30457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.254785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51272 (local address 127.7.113.253:35389)
0806 04:50:55.255398 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:55.255403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:55.255426 (+ 23us) server_negotiation.cc:407] Connection header received
0806 04:50:55.255469 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:55.255474 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:55.255639 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:55.255796 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:55.256518 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.257576 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.258696 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.259255 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.259439 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.262723 (+ 3284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:55.262738 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:55.262756 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:55.262795 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:55.266497 (+ 3702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.267127 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.267138 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.267143 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.267289 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.267644 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.267652 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.267657 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.268104 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:55.268336 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:55.268644 (+ 308us) server_negotiation.cc:299] Negotiation successful
0806 04:50:55.268915 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":352,"threads_started":1}
I20260806 04:50:55.271736 30453 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } has no permanent_uuid. Determining permanent_uuid...
I20260806 04:50:55.273020 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.272580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37814)
0806 04:50:55.272762 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.272884 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 04:50:55.273281 30404 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
I20260806 04:50:55.274729 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.274431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37830)
0806 04:50:55.274558 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.274634 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 04:50:55.274942 30453 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:44183: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.252.keytab.
Entry for principal kudu/127.7.113.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.252.keytab.
I20260806 04:50:55.295919 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.252:44183
--webserver_interface=127.7.113.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.252.keytab
--principal=kudu/127.7.113.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:43889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:35655,127.7.113.253:35389,127.7.113.252:44183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:50:55.324211 30453 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } attempt: 1
I20260806 04:50:55.325438 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.324995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37836)
0806 04:50:55.325172 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.325292 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 04:50:55.326421 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.326075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37838)
0806 04:50:55.326243 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.326314 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260806 04:50:55.326663 30453 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:44183: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
I20260806 04:50:55.394954 30453 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } attempt: 2
I20260806 04:50:55.396087 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.395658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37844)
0806 04:50:55.395847 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.395935 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260806 04:50:55.397032 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.396695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37850)
0806 04:50:55.396835 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.396924 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 04:50:55.397267 30453 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:44183: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
I20260806 04:50:55.403203 30378 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } attempt: 5
Aug 06 04:50:55 dist-test-slave-0b58 krb5kdc[30297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991854, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for kudu/127.7.113.253@KRBTEST.COM
I20260806 04:50:55.417706 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.403787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:35389 (local address 127.0.0.1:51288)
0806 04:50:55.403992 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.404013 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:55.404152 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:55.404527 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:55.404532 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:55.405116 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:55.405355 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.405368 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.406310 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.406316 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.407752 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.407771 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.408589 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.408598 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.408908 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.409556 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:55.409579 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:55.411905 (+ 2326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:55.415515 (+ 3610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.415519 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.415522 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.415891 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.416338 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.416341 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.416343 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.416465 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.417071 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:55.417074 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:55.417194 (+ 120us) client_negotiation.cc:769] Sending connection context
0806 04:50:55.417299 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 04:50:55.417479 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 04:50:55.417945 30457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.403855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51288 (local address 127.7.113.253:35389)
0806 04:50:55.404006 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:55.404011 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:55.404085 (+ 74us) server_negotiation.cc:407] Connection header received
0806 04:50:55.404300 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:55.404305 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:55.404383 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:55.404463 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:55.405487 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.406156 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.407932 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.408422 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.408512 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.412097 (+ 3585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:55.412103 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:55.412108 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:55.412144 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:55.415376 (+ 3232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.416006 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.416014 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.416019 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.416172 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.416569 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.416574 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.416577 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.416950 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:55.417080 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:55.417426 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 04:50:55.417639 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 04:50:55.418979 30378 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } has no permanent_uuid. Determining permanent_uuid...
I20260806 04:50:55.419935 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.419578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37852)
0806 04:50:55.419726 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.419808 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 04:50:55.420873 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.420574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37862)
0806 04:50:55.420707 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.420787 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 04:50:55.421085 30378 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:44183: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
I20260806 04:50:55.472383 30378 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } attempt: 1
I20260806 04:50:55.473527 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.473080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37868)
0806 04:50:55.473269 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.473360 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260806 04:50:55.474601 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.474323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37872)
0806 04:50:55.474451 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.474510 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 04:50:55.474881 30378 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:44183: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
I20260806 04:50:55.488471 30453 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } attempt: 3
I20260806 04:50:55.489476 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.489081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37888)
0806 04:50:55.489266 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.489342 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 04:50:55.490502 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.490126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37892)
0806 04:50:55.490338 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.490403 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144}
W20260806 04:50:55.490722 30453 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:44183: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
I20260806 04:50:55.543099 30378 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } attempt: 2
I20260806 04:50:55.544317 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.543864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37904)
0806 04:50:55.544067 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.544150 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 04:50:55.545192 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.544894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37912)
0806 04:50:55.545036 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.545101 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 04:50:55.545387 30378 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:44183: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
W20260806 04:50:55.627060 30460 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 04:50:55.627442 30460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:55.627558 30460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:55.627702 30460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260806 04:50:55.633920 30453 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } attempt: 4
I20260806 04:50:55.635007 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.634515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37916)
0806 04:50:55.634751 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.634834 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260806 04:50:55.635040 30460 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:55.635147 30460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:55.635242 30460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:55.635321 30460 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:55.635449 30460 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:55.635970 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.635668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37928)
0806 04:50:55.635805 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.635873 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 04:50:55.636206 30453 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:44183: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
I20260806 04:50:55.646265 30460 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:43889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:35655,127.7.113.253:35389,127.7.113.252:44183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.252.keytab
--principal=kudu/127.7.113.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.252:44183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.113.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:55.647516 30460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:55.648896 30460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 04:50:55.651579 30378 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } attempt: 3
I20260806 04:50:55.652688 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.652152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37942)
0806 04:50:55.652421 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.652520 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 04:50:55.653759 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.653295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37946)
0806 04:50:55.653506 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.653607 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260806 04:50:55.654016 30378 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:44183: Network error: Client connection negotiation failed: client connection to 127.7.113.252:44183: connect: Connection refused (error 111)
W20260806 04:50:55.660379 30465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:55.660467 30466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:55.660444 30468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:55.661375 30460 server_base.cc:1034] running on GCE node
I20260806 04:50:55.662137 30460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:55.663468 30460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:55.664711 30460 hybrid_clock.cc:648] HybridClock initialized: now 1785991855664638 us; error 46 us; skew 500 ppm
I20260806 04:50:55.665032 30460 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:55 dist-test-slave-0b58 krb5kdc[30297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991855, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:55.668154 30460 init.cc:377] Logged in from keytab as kudu/127.7.113.252@KRBTEST.COM (short username kudu)
I20260806 04:50:55.669584 30460 webserver.cc:460] Webserver started at http://127.7.113.252:43097/ using document root <none> and password file <none>
I20260806 04:50:55.670238 30460 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:55.670323 30460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:55.670673 30460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:55.673492 30460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/data/instance:
uuid: "1224c5ab07de4103b8e6c96b5f718331"
format_stamp: "Formatted at 2026-08-06 04:50:55 on dist-test-slave-0b58"
server_key: "7f3a7d448745c88734694544c7215bc9"
server_key_iv: "9558e75fb552299750d84dc9062a68b1"
server_key_version: "encryptionkey@0"
I20260806 04:50:55.674212 30460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/wal/instance:
uuid: "1224c5ab07de4103b8e6c96b5f718331"
format_stamp: "Formatted at 2026-08-06 04:50:55 on dist-test-slave-0b58"
server_key: "7f3a7d448745c88734694544c7215bc9"
server_key_iv: "9558e75fb552299750d84dc9062a68b1"
server_key_version: "encryptionkey@0"
I20260806 04:50:55.679019 30460 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 04:50:55.682294 30475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:55.683614 30460 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 04:50:55.683815 30460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/wal
uuid: "1224c5ab07de4103b8e6c96b5f718331"
format_stamp: "Formatted at 2026-08-06 04:50:55 on dist-test-slave-0b58"
server_key: "7f3a7d448745c88734694544c7215bc9"
server_key_iv: "9558e75fb552299750d84dc9062a68b1"
server_key_version: "encryptionkey@0"
I20260806 04:50:55.684018 30460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:55.707988 30460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:55.712102 30460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:55.712425 30460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:55.729815 30460 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.252:44183
I20260806 04:50:55.729846 30526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.252:44183 every 8 connection(s)
I20260806 04:50:55.730996 30460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/data/info.pb
I20260806 04:50:55.733021 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 30460
I20260806 04:50:55.733203 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785991498713577-7623-0/minicluster-data/master-2/wal/instance
I20260806 04:50:55.733649 7623 external_mini_cluster.cc:1428] Setting key 5510576ead6fe2ad1e436f6eed0b71e3
I20260806 04:50:55.734544 30527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:55.743810 30527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:50:55 dist-test-slave-0b58 krb5kdc[30297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.252@KRBTEST.COM
Aug 06 04:50:55 dist-test-slave-0b58 krb5kdc[30297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991855, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.252@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:50:55.756798 30530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.735313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37960 (local address 127.7.113.252:44183)
0806 04:50:55.736104 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:55.736114 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:55.736154 (+ 40us) server_negotiation.cc:407] Connection header received
0806 04:50:55.737729 (+ 1575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:55.737748 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:55.738095 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:55.738408 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:55.740224 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.741611 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.743357 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.743972 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.744104 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.748789 (+ 4685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:55.748798 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:55.748810 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:55.748857 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:55.752486 (+ 3629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.753291 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.753297 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.753303 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.753476 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.753907 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.753910 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.753912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.754336 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:55.754627 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:55.755088 (+ 461us) server_negotiation.cc:299] Negotiation successful
0806 04:50:55.755485 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":397,"threads_started":1}
I20260806 04:50:55.761586 30381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.746358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41746 (local address 127.7.113.254:35655)
0806 04:50:55.746568 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:55.746576 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:55.747084 (+ 508us) server_negotiation.cc:407] Connection header received
0806 04:50:55.747282 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:55.747288 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:55.747377 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:55.747474 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:55.748637 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.749760 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.751394 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.752041 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.752174 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.755501 (+ 3327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:55.755507 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:55.755511 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:55.755548 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:55.758788 (+ 3240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.759540 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.759546 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.759549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.759712 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.760164 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.760169 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.760172 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.760545 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:55.760712 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:55.761175 (+ 463us) server_negotiation.cc:299] Negotiation successful
0806 04:50:55.761318 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 04:50:55.761865 30531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.746349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:35655 (local address 127.0.0.1:41746)
0806 04:50:55.746947 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.746984 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:55.747159 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:55.747534 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:55.747540 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:55.748201 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:55.748491 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.748500 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.749955 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.749961 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.751250 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.751262 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.752211 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.752276 (+ 65us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.752429 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.753003 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:55.753037 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:55.755234 (+ 2197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:55.758920 (+ 3686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.758936 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.758944 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.759429 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.759850 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.759854 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.759858 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.760046 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.760708 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:55.760716 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:55.760896 (+ 180us) client_negotiation.cc:769] Sending connection context
0806 04:50:55.761096 (+ 200us) client_negotiation.cc:240] Negotiation successful
0806 04:50:55.761438 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":293,"threads_started":1}
I20260806 04:50:55.763178 30527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:50:55 dist-test-slave-0b58 krb5kdc[30297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
Aug 06 04:50:55 dist-test-slave-0b58 krb5kdc[30297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991855, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.252@KRBTEST.COM for kudu/127.7.113.253@KRBTEST.COM
I20260806 04:50:55.776666 30532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.759801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41758 (local address 127.7.113.254:35655)
0806 04:50:55.760414 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:55.760419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:55.760441 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:50:55.760482 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:55.760486 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:55.760545 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:55.760646 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:55.762235 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.763203 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.764708 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.765107 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.765289 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.770857 (+ 5568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:55.770864 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:55.770870 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:55.770909 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:55.774241 (+ 3332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.774802 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.774806 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.774809 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.774956 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.775310 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.775315 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.775318 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.775579 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:55.775828 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:55.776092 (+ 264us) server_negotiation.cc:299] Negotiation successful
0806 04:50:55.776317 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":248,"threads_started":1}
I20260806 04:50:55.777411 30457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.763929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51290 (local address 127.7.113.253:35389)
0806 04:50:55.764142 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:55.764146 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:55.764162 (+ 16us) server_negotiation.cc:407] Connection header received
0806 04:50:55.764295 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:55.764303 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:55.764387 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:55.764464 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:55.765258 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.765951 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.767718 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.768136 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.768232 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.771545 (+ 3313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:55.771554 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:55.771561 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:55.771600 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:55.774836 (+ 3236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.775381 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.775388 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.775391 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.775521 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.775901 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.775906 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.775909 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.776233 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:55.776412 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:55.776813 (+ 401us) server_negotiation.cc:299] Negotiation successful
0806 04:50:55.777035 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 04:50:55.777674 30531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.763878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:35389 (local address 127.0.0.1:51290)
0806 04:50:55.764045 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.764062 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:55.764152 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:55.764514 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:55.764521 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:55.764973 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:55.765102 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.765127 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.766081 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.766089 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.767554 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.767571 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.768307 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.768315 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.768548 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.769045 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:55.769084 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:55.771348 (+ 2264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:55.774948 (+ 3600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.774951 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.774953 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.775264 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.775627 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.775632 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.775635 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.775779 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.776390 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:55.776394 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:55.776558 (+ 164us) client_negotiation.cc:769] Sending connection context
0806 04:50:55.776715 (+ 157us) client_negotiation.cc:240] Negotiation successful
0806 04:50:55.777355 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 04:50:55.778752 30527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:50:55 dist-test-slave-0b58 krb5kdc[30297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991855, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.252@KRBTEST.COM for kudu/127.7.113.252@KRBTEST.COM
Aug 06 04:50:55 dist-test-slave-0b58 krb5kdc[30297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.253@KRBTEST.COM
I20260806 04:50:55.791256 30530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.779404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37966 (local address 127.7.113.252:44183)
0806 04:50:55.779587 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:55.779594 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:55.779676 (+ 82us) server_negotiation.cc:407] Connection header received
0806 04:50:55.779782 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:55.779787 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:55.779849 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:55.779952 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:55.780591 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.781219 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.782276 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.782682 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.782813 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.785937 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:55.785943 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:55.785948 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:55.785981 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:55.788835 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.789457 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.789462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.789466 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.789606 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.789944 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.789951 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.789955 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.790292 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:55.790441 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:55.790781 (+ 340us) server_negotiation.cc:299] Negotiation successful
0806 04:50:55.790966 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 04:50:55.791611 30531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.779445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37966)
0806 04:50:55.779620 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.779632 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:55.779706 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:55.779954 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:55.779957 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:55.780237 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:55.780422 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.780430 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.781330 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.781338 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.782147 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.782157 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.782830 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.782836 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.783050 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.783513 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:55.783528 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:55.785765 (+ 2237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:55.788970 (+ 3205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.788976 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.788981 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.789348 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.789719 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.789722 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.789724 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.789845 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.790402 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:55.790405 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:55.790540 (+ 135us) client_negotiation.cc:769] Sending connection context
0806 04:50:55.790714 (+ 174us) client_negotiation.cc:240] Negotiation successful
0806 04:50:55.791185 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":116}
I20260806 04:50:55.793301 30457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.778380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51304 (local address 127.7.113.253:35389)
0806 04:50:55.778545 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:55.778550 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:55.778566 (+ 16us) server_negotiation.cc:407] Connection header received
0806 04:50:55.778685 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:55.778690 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:55.778754 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:55.778844 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:55.780148 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.780882 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.782088 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.782498 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.782624 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.787305 (+ 4681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:55.787323 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:55.787327 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:55.787359 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:55.790430 (+ 3071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.791221 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.791228 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.791231 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.791395 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.791849 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.791854 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.791857 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.792148 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:55.792454 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:55.792716 (+ 262us) server_negotiation.cc:299] Negotiation successful
0806 04:50:55.792974 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 04:50:55.797375 30527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331: Bootstrap starting.
I20260806 04:50:55.797940 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:50:55.800567 30527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:55.801581 30527 log.cc:824] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:55.800458 30353 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41758
I20260806 04:50:55.804322 30527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331: No bootstrap required, opened a new log
I20260806 04:50:55.810997 30527 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } }
I20260806 04:50:55.811312 30527 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1224c5ab07de4103b8e6c96b5f718331, State: Initialized, Role: FOLLOWER
I20260806 04:50:55.811708 30527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } }
I20260806 04:50:55.812570 30534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } } }
I20260806 04:50:55.812896 30534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:50:55.813730 30527 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 04:50:55.822991 30545 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 04:50:55.823159 30545 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 04:50:55.820912 30460 master_runner.cc:186] Error getting master registration for 127.7.113.254:35655: OK, instance_id { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" instance_seqno: 1785991854695348 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 04:50:55.828761 30460 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 04:50:55.831231 30378 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } attempt: 4
Aug 06 04:50:55 dist-test-slave-0b58 krb5kdc[30297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991854, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for kudu/127.7.113.252@KRBTEST.COM
I20260806 04:50:55.846997 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.831814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37982)
0806 04:50:55.832033 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.832054 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:55.832165 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:55.832698 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:55.832705 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:55.833144 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:55.833304 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.833312 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.834731 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.834736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.835709 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.835719 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.836535 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.836541 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.836758 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.837384 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:55.837406 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:55.840241 (+ 2835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:55.844203 (+ 3962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.844209 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.844213 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.844769 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.845144 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.845149 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.845153 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.845328 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.845953 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:55.845959 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:55.846155 (+ 196us) client_negotiation.cc:769] Sending connection context
0806 04:50:55.846316 (+ 161us) client_negotiation.cc:240] Negotiation successful
0806 04:50:55.846589 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260806 04:50:55.847024 30530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.831903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37982 (local address 127.7.113.252:44183)
0806 04:50:55.832419 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:55.832428 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:55.832446 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:50:55.832503 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:55.832508 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:55.832579 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:55.832663 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:55.833456 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.834600 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.835850 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.836386 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.836509 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.840471 (+ 3962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:55.840478 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:55.840483 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:55.840521 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:55.844064 (+ 3543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.844876 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.844882 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.844885 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.845028 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.845449 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.845453 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.845456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.845826 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:55.845972 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:55.846455 (+ 483us) server_negotiation.cc:299] Negotiation successful
0806 04:50:55.846667 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352}
I20260806 04:50:55.852728 30378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d: Bootstrap starting.
I20260806 04:50:55.856715 30378 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:55.857985 30378 log.cc:824] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:55.861001 30378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d: No bootstrap required, opened a new log
I20260806 04:50:55.868392 30378 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } }
I20260806 04:50:55.868789 30378 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a9d6d86eb3e4244b9b2b74d8dcd976d, State: Initialized, Role: FOLLOWER
I20260806 04:50:55.869292 30378 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } }
I20260806 04:50:55.870353 30548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } } }
I20260806 04:50:55.870735 30548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:50:55.871527 30378 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:55.871622 30353 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 04:50:55.871835 30353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:55.875481 30353 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } }
I20260806 04:50:55.879839 30502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1224c5ab07de4103b8e6c96b5f718331"
I20260806 04:50:55.880345 30502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:55.883854 30502 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a9d6d86eb3e4244b9b2b74d8dcd976d in term 1.
I20260806 04:50:55.884485 30330 leader_election.cc:302] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1224c5ab07de4103b8e6c96b5f718331, 2a9d6d86eb3e4244b9b2b74d8dcd976d; no voters:
I20260806 04:50:55.885058 30548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:50:55.894353 30353 leader_election.cc:288] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [CANDIDATE]: Term 1 election: Requested vote from peers f8e86c4cdb0b4a7d8d6212162b0483f5 (127.7.113.253:35389), 1224c5ab07de4103b8e6c96b5f718331 (127.7.113.252:44183)
I20260806 04:50:55.897863 30548 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [term 1 LEADER]: Becoming Leader. State: Replica: 2a9d6d86eb3e4244b9b2b74d8dcd976d, State: Running, Role: LEADER
I20260806 04:50:55.898693 30548 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } }
I20260806 04:50:55.930054 30562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a9d6d86eb3e4244b9b2b74d8dcd976d. Latest consensus state: current_term: 1 leader_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } } }
I20260806 04:50:55.932200 30562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:55.935429 30453 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } attempt: 5
W20260806 04:50:55.936170 30332 tablet.cc:2369] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:50:55.885703 30311 master_runner.cc:186] Error getting master registration for 127.7.113.253:35389: OK, instance_id { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" instance_seqno: 1785991855210263 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 04:50:55.949190 30311 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 04:50:55.951807 30532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.918573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41762 (local address 127.7.113.254:35655)
0806 04:50:55.918819 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:55.918828 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:55.921873 (+ 3045us) server_negotiation.cc:407] Connection header received
0806 04:50:55.922247 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:55.922259 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:55.922372 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:55.922459 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:55.928453 (+ 5994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.929735 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.934585 (+ 4850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.935579 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.935706 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.941686 (+ 5980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:55.941695 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:55.941703 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:55.941756 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:55.946628 (+ 4872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.947992 (+ 1364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.948000 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.948007 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.948216 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.949009 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.949017 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.949023 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.949833 (+ 810us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:55.950184 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:55.950918 (+ 734us) server_negotiation.cc:299] Negotiation successful
0806 04:50:55.951239 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
Aug 06 04:50:55 dist-test-slave-0b58 krb5kdc[30297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991855, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.253@KRBTEST.COM for kudu/127.7.113.252@KRBTEST.COM
W20260806 04:50:55.958058 30560 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 04:50:55.958186 30560 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 04:50:55.958319 30571 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:50:55.960757 30571 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260806 04:50:55.964392 30481 tablet.cc:2369] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:50:55.967252 30572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.936679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37990 (local address 127.7.113.252:44183)
0806 04:50:55.948690 (+ 12011us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:55.948699 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:55.948725 (+ 26us) server_negotiation.cc:407] Connection header received
0806 04:50:55.948858 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:55.948867 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:55.948961 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:55.950241 (+ 1280us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:55.950524 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.951774 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.953577 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.954248 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.955286 (+ 1038us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.958848 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:55.958856 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:55.958861 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:55.958897 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:55.962627 (+ 3730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.963468 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.963474 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.963478 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.963619 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.964045 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.964052 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.964056 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.965704 (+ 1648us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:55.965836 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:55.966523 (+ 687us) server_negotiation.cc:299] Negotiation successful
0806 04:50:55.966729 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":11877,"thread_start_us":11715,"threads_started":1}
I20260806 04:50:55.968217 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.935946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:44183 (local address 127.0.0.1:37990)
0806 04:50:55.936345 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:55.936365 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:55.936469 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:55.949184 (+ 12715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:55.949190 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:55.949790 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:55.950064 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.950083 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.951932 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.951937 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.953372 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:55.953387 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.954445 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.954453 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:55.954714 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.955543 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:55.955564 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:55.958622 (+ 3058us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:55.962801 (+ 4179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.962807 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.962812 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.963324 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.963750 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:55.963754 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:55.963757 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:55.963919 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:55.965917 (+ 1998us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:55.965923 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:55.966074 (+ 151us) client_negotiation.cc:769] Sending connection context
0806 04:50:55.966230 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 04:50:55.967812 (+ 1582us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235}
I20260806 04:50:55.975100 30453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5: Bootstrap starting.
I20260806 04:50:55.976603 30457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.920318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51312 (local address 127.7.113.253:35389)
0806 04:50:55.920492 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:55.920498 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:55.926968 (+ 6470us) server_negotiation.cc:407] Connection header received
0806 04:50:55.927325 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:55.927331 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:55.927426 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:55.927496 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:55.956589 (+ 29093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.957717 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.963753 (+ 6036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.964469 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.964577 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.969424 (+ 4847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:55.969431 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:55.969436 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:55.969474 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:55.973233 (+ 3759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.974116 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.974122 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.974125 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.974274 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.974749 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.974756 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.974759 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.975127 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:55.975440 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:55.975990 (+ 550us) server_negotiation.cc:299] Negotiation successful
0806 04:50:55.976205 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 04:50:55.978422 30530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:55.924936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37984 (local address 127.7.113.252:44183)
0806 04:50:55.925176 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:55.925184 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:55.931575 (+ 6391us) server_negotiation.cc:407] Connection header received
0806 04:50:55.931821 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:55.931833 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:55.931938 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:55.932064 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:55.960571 (+ 28507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.961874 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.965492 (+ 3618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:55.966175 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:55.966260 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:55.971532 (+ 5272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:55.971541 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:55.971546 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:55.971586 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:55.975440 (+ 3854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.976320 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.976325 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.976329 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.976450 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:55.976909 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:55.976913 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:55.976916 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:55.977229 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:55.977443 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:55.977856 (+ 413us) server_negotiation.cc:299] Negotiation successful
0806 04:50:55.978064 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":87}
I20260806 04:50:55.981423 30453 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5: Neither blocks nor log segments found. Creating new log.
I20260806 04:50:55.984200 30502 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331 [term 1 FOLLOWER]: Refusing update from remote peer 2a9d6d86eb3e4244b9b2b74d8dcd976d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:50:55.985231 30562 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:50:55.993465 30453 log.cc:824] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5: Log is configured to *not* fsync() on all Append() calls
I20260806 04:50:55.999786 30453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5: No bootstrap required, opened a new log
I20260806 04:50:56.001570 30534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a9d6d86eb3e4244b9b2b74d8dcd976d. Latest consensus state: current_term: 1 leader_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } } }
I20260806 04:50:56.001842 30534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:50:56.014022 30534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } } }
I20260806 04:50:56.014258 30534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:50:56.020453 30453 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } }
I20260806 04:50:56.020853 30453 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8e86c4cdb0b4a7d8d6212162b0483f5, State: Initialized, Role: FOLLOWER
I20260806 04:50:56.021375 30453 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } }
I20260806 04:50:56.022759 30579 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } } }
I20260806 04:50:56.023485 30579 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:50:56.023674 30562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } } }
I20260806 04:50:56.023948 30562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:56.024420 30571 catalog_manager.cc:1347] Generated new cluster ID: 9dd538d9ed83494daa5aca75063d3fef
I20260806 04:50:56.024518 30571 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:50:56.034969 30453 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:50:56.035358 30426 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:50:56.038736 30426 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5 [term 1 FOLLOWER]: Refusing update from remote peer 2a9d6d86eb3e4244b9b2b74d8dcd976d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:50:56.039659 30427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5"
I20260806 04:50:56.042270 30562 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:50:56.042869 30427 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a9d6d86eb3e4244b9b2b74d8dcd976d in term 1.
I20260806 04:50:56.051955 30571 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:50:56.053637 30571 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:50:56.071651 30571 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d: Generated new TSK 0
I20260806 04:50:56.072546 30571 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:50:56.075377 30579 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a9d6d86eb3e4244b9b2b74d8dcd976d. Latest consensus state: current_term: 1 leader_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } } }
I20260806 04:50:56.075718 30579 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:50:56.076352 30583 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } } }
I20260806 04:50:56.076751 30583 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:50:56.077733 30562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a9d6d86eb3e4244b9b2b74d8dcd976d" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 35655 } } peers { permanent_uuid: "f8e86c4cdb0b4a7d8d6212162b0483f5" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 35389 } } peers { permanent_uuid: "1224c5ab07de4103b8e6c96b5f718331" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 44183 } } }
I20260806 04:50:56.077977 30562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a9d6d86eb3e4244b9b2b74d8dcd976d [sys.catalog]: This master's current role is: LEADER
I20260806 04:50:56.126675 30596 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260806 04:50:56.186573 30532 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:50:56.171712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41778 (local address 127.7.113.254:35655)
0806 04:50:56.171985 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:56.171991 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:56.183122 (+ 11131us) server_negotiation.cc:407] Connection header received
0806 04:50:56.184232 (+ 1110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:56.184242 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:56.184393 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:56.184488 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:56.186179 (+ 1691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41778: BlockingRecv error: recv got EOF from 127.0.0.1:41778 (error 108)
Metrics: {"server-negotiator.queue_time_us":136}
W20260806 04:50:56.190794 30457 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:50:56.172031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51320 (local address 127.7.113.253:35389)
0806 04:50:56.172242 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:56.172251 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:56.189126 (+ 16875us) server_negotiation.cc:407] Connection header received
0806 04:50:56.189378 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:56.189383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:56.189479 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:56.189545 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:56.190563 (+ 1018us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51320: BlockingRecv error: recv got EOF from 127.0.0.1:51320 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260806 04:50:56.190845 30530 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:50:56.178260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38000 (local address 127.7.113.252:44183)
0806 04:50:56.178459 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:56.178465 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:56.189028 (+ 10563us) server_negotiation.cc:407] Connection header received
0806 04:50:56.189303 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:56.189312 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:56.189399 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:56.189472 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:56.190557 (+ 1085us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38000: BlockingRecv error: recv got EOF from 127.0.0.1:38000 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260806 04:50:56.197798 30457 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:50:56.195750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51326 (local address 127.7.113.253:35389)
0806 04:50:56.195904 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:56.195909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:56.196488 (+ 579us) server_negotiation.cc:407] Connection header received
0806 04:50:56.196698 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:56.196702 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:56.196785 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:56.196882 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:56.197519 (+ 637us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51326: BlockingRecv error: recv got EOF from 127.0.0.1:51326 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260806 04:50:56.205334 30457 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:50:56.203376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51328 (local address 127.7.113.253:35389)
0806 04:50:56.203585 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:56.203593 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:56.204097 (+ 504us) server_negotiation.cc:407] Connection header received
0806 04:50:56.204307 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:56.204312 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:56.204386 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:56.204482 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:56.205136 (+ 654us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51328: BlockingRecv error: recv got EOF from 127.0.0.1:51328 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 04:50:56.212113 30457 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:50:56.210188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51342 (local address 127.7.113.253:35389)
0806 04:50:56.210375 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:56.210383 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:56.210865 (+ 482us) server_negotiation.cc:407] Connection header received
0806 04:50:56.211047 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:56.211052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:56.211133 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:56.211236 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:56.211894 (+ 658us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51342: BlockingRecv error: recv got EOF from 127.0.0.1:51342 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260806 04:50:56.268146 30457 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:50:56.265908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51358 (local address 127.7.113.253:35389)
0806 04:50:56.266160 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:56.266170 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:56.266738 (+ 568us) server_negotiation.cc:407] Connection header received
0806 04:50:56.266952 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:56.266958 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:56.267040 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:56.267145 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:56.267934 (+ 789us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51358: BlockingRecv error: recv got EOF from 127.0.0.1:51358 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
W20260806 04:50:56.281878 30457 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:50:56.279799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51366 (local address 127.7.113.253:35389)
0806 04:50:56.279978 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:56.279983 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:56.280120 (+ 137us) server_negotiation.cc:407] Connection header received
0806 04:50:56.280432 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:56.280441 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:56.280515 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:56.280616 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:56.281628 (+ 1012us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51366: BlockingRecv error: recv got EOF from 127.0.0.1:51366 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260806 04:50:56.302953 30457 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:50:56.300833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51382 (local address 127.7.113.253:35389)
0806 04:50:56.301058 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:56.301067 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:56.301552 (+ 485us) server_negotiation.cc:407] Connection header received
0806 04:50:56.301757 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:56.301766 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:56.301846 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:56.301956 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:56.302707 (+ 751us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51382: BlockingRecv error: recv got EOF from 127.0.0.1:51382 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260806 04:50:56.340938 30457 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:50:56.338285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51388 (local address 127.7.113.253:35389)
0806 04:50:56.338973 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:56.338982 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:56.339509 (+ 527us) server_negotiation.cc:407] Connection header received
0806 04:50:56.339718 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:56.339722 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:56.339808 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:56.339914 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:56.340680 (+ 766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51388: BlockingRecv error: recv got EOF from 127.0.0.1:51388 (error 108)
Metrics: {"server-negotiator.queue_time_us":506}
W20260806 04:50:56.416628 30457 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:50:56.414217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51392 (local address 127.7.113.253:35389)
0806 04:50:56.414457 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:56.414467 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:56.415016 (+ 549us) server_negotiation.cc:407] Connection header received
0806 04:50:56.415250 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:56.415256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:56.415334 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:56.415445 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:56.416379 (+ 934us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51392: BlockingRecv error: recv got EOF from 127.0.0.1:51392 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260806 04:50:56.551976 30457 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:50:56.550314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51404 (local address 127.7.113.253:35389)
0806 04:50:56.550531 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:56.550539 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:56.550688 (+ 149us) server_negotiation.cc:407] Connection header received
0806 04:50:56.550854 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:56.550858 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:56.550951 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:56.551035 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:56.551750 (+ 715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51404: BlockingRecv error: recv got EOF from 127.0.0.1:51404 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260806 04:50:56.815838 30457 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:50:56.813991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51416 (local address 127.7.113.253:35389)
0806 04:50:56.814237 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:56.814243 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:56.814450 (+ 207us) server_negotiation.cc:407] Connection header received
0806 04:50:56.814646 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:56.814650 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:56.814723 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:56.814805 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:56.815622 (+ 817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51416: BlockingRecv error: recv got EOF from 127.0.0.1:51416 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 04:50:56.825069 30545 catalog_manager.cc:1259] Loaded cluster ID: 9dd538d9ed83494daa5aca75063d3fef
I20260806 04:50:56.825157 30545 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331: loading cluster ID for follower catalog manager: success
I20260806 04:50:56.827535 30545 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331: acquiring CA information for follower catalog manager: success
I20260806 04:50:56.829234 30545 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1224c5ab07de4103b8e6c96b5f718331: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 04:50:57.130913 30596 catalog_manager.cc:1259] Loaded cluster ID: 9dd538d9ed83494daa5aca75063d3fef
I20260806 04:50:57.131032 30596 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5: loading cluster ID for follower catalog manager: success
I20260806 04:50:57.133649 30596 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5: acquiring CA information for follower catalog manager: success
I20260806 04:50:57.135500 30596 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f8e86c4cdb0b4a7d8d6212162b0483f5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 04:50:57.338292 30662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:57.331781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51430 (local address 127.7.113.253:35389)
0806 04:50:57.332630 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:57.332634 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:57.332650 (+ 16us) server_negotiation.cc:407] Connection header received
0806 04:50:57.332712 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:57.332715 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:57.332841 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:57.332994 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:50:57.333465 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:57.334309 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:57.335806 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:57.336442 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:57.336579 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:57.337103 (+ 524us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:50:57.337622 (+ 519us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:50:57.337782 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:57.337847 (+ 65us) server_negotiation.cc:299] Negotiation successful
0806 04:50:57.337942 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":491,"threads_started":1}
I20260806 04:50:57.351034 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:57.344551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38002 (local address 127.7.113.252:44183)
0806 04:50:57.345292 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:57.345298 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:57.345320 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:50:57.345426 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:57.345432 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:57.345625 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:57.345821 (+ 196us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:50:57.346151 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:57.347257 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:57.348551 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:57.349194 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:57.349329 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:57.349773 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:50:57.350409 (+ 636us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:50:57.350560 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:57.350611 (+ 51us) server_negotiation.cc:299] Negotiation successful
0806 04:50:57.350707 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":508,"threads_started":1}
I20260806 04:50:57.391412 30675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:57.357669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41786 (local address 127.7.113.254:35655)
0806 04:50:57.381697 (+ 24028us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:57.381704 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:57.382429 (+ 725us) server_negotiation.cc:407] Connection header received
0806 04:50:57.383049 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:57.383056 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:57.383284 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:57.383448 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:50:57.384304 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:57.385513 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:57.388540 (+ 3027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:57.389071 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:57.389193 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:57.389979 (+ 786us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:50:57.390441 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:50:57.390527 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:57.391020 (+ 493us) server_negotiation.cc:299] Negotiation successful
0806 04:50:57.391104 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23868,"thread_start_us":24045,"threads_started":1}
I20260806 04:50:57.395870 30662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:57.357345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51440 (local address 127.7.113.253:35389)
0806 04:50:57.357764 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:57.357776 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:57.389145 (+ 31369us) server_negotiation.cc:407] Connection header received
0806 04:50:57.389321 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:57.389327 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:57.389430 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:57.389529 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:50:57.390281 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:57.391386 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:57.393481 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:57.394133 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:57.394230 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:57.394868 (+ 638us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:50:57.395030 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:50:57.395101 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:57.395382 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 04:50:57.395484 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249}
I20260806 04:50:57.396629 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:57.357539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38010 (local address 127.7.113.252:44183)
0806 04:50:57.357952 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:57.357958 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:57.388802 (+ 30844us) server_negotiation.cc:407] Connection header received
0806 04:50:57.389516 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:57.389522 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:57.389612 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:57.389693 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:50:57.390531 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:57.391572 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:57.394322 (+ 2750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:57.394969 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:57.395070 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:57.395770 (+ 700us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:50:57.395901 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:50:57.395969 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:57.396214 (+ 245us) server_negotiation.cc:299] Negotiation successful
0806 04:50:57.396343 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300}
I20260806 04:50:57.397886 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 30311
I20260806 04:50:57.398974 30373 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:57.529479 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 30311
W20260806 04:50:57.552083 30477 connection.cc:535] server connection from 127.0.0.1:37982 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 04:50:57.552562 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 30385
I20260806 04:50:57.553637 30448 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:57.658440 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 30385
I20260806 04:50:57.680539 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 30460
I20260806 04:50:57.681648 30522 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:50:57.786597 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 30460
2026-08-06T04:50:57Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4952 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 04:50:57 dist-test-slave-0b58 krb5kdc[30682](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 04:50:57 dist-test-slave-0b58 krb5kdc[30682](info): set up 2 sockets
Aug 06 04:50:57 dist-test-slave-0b58 krb5kdc[30682](info): commencing operation
krb5kdc: starting...
W20260806 04:50:58.927146 7623 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/test-user.keytab.
Aug 06 04:50:59 dist-test-slave-0b58 krb5kdc[30682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T04:50:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T04:50:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.113.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
Entry for principal kudu/127.7.113.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab.
I20260806 04:50:59.245836 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:37071
--webserver_interface=127.7.113.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:34687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:37071,127.7.113.253:33695,127.7.113.252:38087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 04:50:59.586773 30695 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 04:50:59.587072 30695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:50:59.587143 30695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:50:59.587224 30695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:50:59.594381 30695 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:50:59.594457 30695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:50:59.594511 30695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:50:59.594553 30695 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:50:59.594604 30695 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:50:59.604005 30695 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:34687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:37071,127.7.113.253:33695,127.7.113.252:38087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.254.keytab
--principal=kudu/127.7.113.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.254:37071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.113.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:50:59.605188 30695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:50:59.606416 30695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:50:59.617573 30700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:59.617610 30703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:50:59.617596 30701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:50:59.618530 30695 server_base.cc:1034] running on GCE node
I20260806 04:50:59.619275 30695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:50:59.620576 30695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:50:59.621793 30695 hybrid_clock.cc:648] HybridClock initialized: now 1785991859621727 us; error 33 us; skew 500 ppm
I20260806 04:50:59.622104 30695 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:50:59 dist-test-slave-0b58 krb5kdc[30682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991859, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:50:59.625166 30695 init.cc:377] Logged in from keytab as kudu/127.7.113.254@KRBTEST.COM (short username kudu)
I20260806 04:50:59.626607 30695 webserver.cc:460] Webserver started at http://127.7.113.254:34191/ using document root <none> and password file <none>
I20260806 04:50:59.627246 30695 fs_manager.cc:359] Metadata directory not provided
I20260806 04:50:59.627378 30695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:50:59.627689 30695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:50:59.630487 30695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/data/instance:
uuid: "0a530de2e7fc485abc5d8f41c7353ef2"
format_stamp: "Formatted at 2026-08-06 04:50:59 on dist-test-slave-0b58"
server_key: "3032831d34a6ec29d72af1b0a7c7ec99"
server_key_iv: "8e4fed4140f241b087afc72307d969db"
server_key_version: "encryptionkey@0"
I20260806 04:50:59.631256 30695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/wal/instance:
uuid: "0a530de2e7fc485abc5d8f41c7353ef2"
format_stamp: "Formatted at 2026-08-06 04:50:59 on dist-test-slave-0b58"
server_key: "3032831d34a6ec29d72af1b0a7c7ec99"
server_key_iv: "8e4fed4140f241b087afc72307d969db"
server_key_version: "encryptionkey@0"
I20260806 04:50:59.636059 30695 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.007s
I20260806 04:50:59.639285 30711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:50:59.640602 30695 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 04:50:59.640774 30695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/wal
uuid: "0a530de2e7fc485abc5d8f41c7353ef2"
format_stamp: "Formatted at 2026-08-06 04:50:59 on dist-test-slave-0b58"
server_key: "3032831d34a6ec29d72af1b0a7c7ec99"
server_key_iv: "8e4fed4140f241b087afc72307d969db"
server_key_version: "encryptionkey@0"
I20260806 04:50:59.640971 30695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:50:59.656965 30695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:50:59.660791 30695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:50:59.661044 30695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:50:59.679230 30695 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.254:37071
I20260806 04:50:59.679250 30762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.254:37071 every 8 connection(s)
I20260806 04:50:59.680567 30695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/data/info.pb
I20260806 04:50:59.682835 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 30695
I20260806 04:50:59.683050 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-0/wal/instance
I20260806 04:50:59.683619 7623 external_mini_cluster.cc:1428] Setting key 1a18a9371e8cc603fd00db9a8dedc6b3
I20260806 04:50:59.684727 30763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:50:59.694573 30763 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:50:59 dist-test-slave-0b58 krb5kdc[30682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991859, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:50:59.719098 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:59.698378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:37071 (local address 127.0.0.1:60318)
0806 04:50:59.699389 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:59.699464 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0806 04:50:59.701458 (+ 1994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:50:59.702367 (+ 909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:50:59.702374 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:50:59.702937 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:50:59.703268 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:59.703285 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:59.705679 (+ 2394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:59.705683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:59.706755 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:50:59.706767 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:50:59.708094 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:50:59.708099 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:50:59.708217 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:59.708937 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:50:59.708958 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:50:59.711045 (+ 2087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:50:59.715328 (+ 4283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:59.715338 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:59.715346 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:59.715710 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:59.716177 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:50:59.716181 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:50:59.716183 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:50:59.716390 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:50:59.717315 (+ 925us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:50:59.717320 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:50:59.717495 (+ 175us) client_negotiation.cc:769] Sending connection context
0806 04:50:59.717688 (+ 193us) client_negotiation.cc:240] Negotiation successful
0806 04:50:59.718060 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":433,"threads_started":1}
I20260806 04:50:59.719130 30767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:59.698379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60318 (local address 127.7.113.254:37071)
0806 04:50:59.700123 (+ 1744us) server_negotiation.cc:206] Beginning negotiation
0806 04:50:59.700133 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:50:59.700217 (+ 84us) server_negotiation.cc:407] Connection header received
0806 04:50:59.701806 (+ 1589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:50:59.701815 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:50:59.702118 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:50:59.702377 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:50:59.703478 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:59.705529 (+ 2051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:59.706896 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:50:59.707885 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:50:59.708099 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:50:59.711273 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:50:59.711285 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:50:59.711310 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:50:59.711351 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:50:59.715196 (+ 3845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:59.715842 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:59.715854 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:59.715860 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:59.716065 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:50:59.716498 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:50:59.716506 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:50:59.716512 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:50:59.717194 (+ 682us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:50:59.717425 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 04:50:59.717888 (+ 463us) server_negotiation.cc:299] Negotiation successful
0806 04:50:59.718230 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":1499,"spinlock_wait_cycles":24448,"thread_start_us":1290,"threads_started":1}
WARNING: no policy specified for kudu/127.7.113.253@KRBTEST.COM; defaulting to no policy
I20260806 04:50:59.721903 30763 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.253@KRBTEST.COM" created.
I20260806 04:50:59.722900 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:59.722535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:33695 (local address 127.0.0.1:42128)
0806 04:50:59.722702 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:59.722808 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260806 04:50:59.723217 30714 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
I20260806 04:50:59.724670 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:59.724376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:33695 (local address 127.0.0.1:42132)
0806 04:50:59.724499 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:59.724562 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 04:50:59.724956 30763 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:33695: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.253.keytab.
Entry for principal kudu/127.7.113.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.253.keytab.
I20260806 04:50:59.757216 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.253:33695
--webserver_interface=127.7.113.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.253.keytab
--principal=kudu/127.7.113.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:34687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:37071,127.7.113.253:33695,127.7.113.252:38087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:50:59.774266 30763 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } attempt: 1
I20260806 04:50:59.775389 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:59.774978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:33695 (local address 127.0.0.1:42146)
0806 04:50:59.775153 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:59.775254 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260806 04:50:59.776477 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:59.776141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:33695 (local address 127.0.0.1:42156)
0806 04:50:59.776302 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:59.776363 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 04:50:59.776716 30763 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:33695: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
I20260806 04:50:59.844971 30763 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } attempt: 2
I20260806 04:50:59.846271 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:59.845786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:33695 (local address 127.0.0.1:42164)
0806 04:50:59.846026 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:59.846118 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260806 04:50:59.847235 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:59.846915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:33695 (local address 127.0.0.1:42166)
0806 04:50:59.847041 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:59.847116 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 04:50:59.847452 30763 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:33695: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
I20260806 04:50:59.938683 30763 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } attempt: 3
I20260806 04:50:59.939900 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:59.939489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:33695 (local address 127.0.0.1:42174)
0806 04:50:59.939677 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:59.939773 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 04:50:59.940918 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:50:59.940615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:33695 (local address 127.0.0.1:42182)
0806 04:50:59.940730 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0806 04:50:59.940798 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 04:50:59.941154 30763 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:33695: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
I20260806 04:51:00.084439 30763 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } attempt: 4
I20260806 04:51:00.085654 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.085160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:33695 (local address 127.0.0.1:42196)
0806 04:51:00.085419 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.085527 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
W20260806 04:51:00.085667 30770 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 04:51:00.086061 30770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:51:00.086180 30770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:51:00.086339 30770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260806 04:51:00.086830 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.086433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:33695 (local address 127.0.0.1:42212)
0806 04:51:00.086590 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.086685 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 04:51:00.087007 30763 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.253:33695: Network error: Client connection negotiation failed: client connection to 127.7.113.253:33695: connect: Connection refused (error 111)
W20260806 04:51:00.093920 30770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:51:00.094007 30770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:51:00.094061 30770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:51:00.094115 30770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:51:00.094164 30770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:51:00.103552 30770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:34687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:37071,127.7.113.253:33695,127.7.113.252:38087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.253.keytab
--principal=kudu/127.7.113.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.253:33695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.113.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:51:00.104912 30770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:51:00.106134 30770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:51:00.117724 30775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:51:00.117763 30776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:51:00.117791 30778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:51:00.118681 30770 server_base.cc:1034] running on GCE node
I20260806 04:51:00.119349 30770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:51:00.120666 30770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:51:00.121877 30770 hybrid_clock.cc:648] HybridClock initialized: now 1785991860121793 us; error 47 us; skew 500 ppm
I20260806 04:51:00.122138 30770 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:51:00 dist-test-slave-0b58 krb5kdc[30682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991860, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:51:00.125222 30770 init.cc:377] Logged in from keytab as kudu/127.7.113.253@KRBTEST.COM (short username kudu)
I20260806 04:51:00.126582 30770 webserver.cc:460] Webserver started at http://127.7.113.253:36223/ using document root <none> and password file <none>
I20260806 04:51:00.127228 30770 fs_manager.cc:359] Metadata directory not provided
I20260806 04:51:00.127353 30770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:51:00.127666 30770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:51:00.130506 30770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/data/instance:
uuid: "ae761055556141d4b2c217be396430b1"
format_stamp: "Formatted at 2026-08-06 04:51:00 on dist-test-slave-0b58"
server_key: "8ebc091e96c917bb54ca2dc7f6564fb0"
server_key_iv: "aa0881c24f12cd21f98d0fad218d7fe6"
server_key_version: "encryptionkey@0"
I20260806 04:51:00.131227 30770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/wal/instance:
uuid: "ae761055556141d4b2c217be396430b1"
format_stamp: "Formatted at 2026-08-06 04:51:00 on dist-test-slave-0b58"
server_key: "8ebc091e96c917bb54ca2dc7f6564fb0"
server_key_iv: "aa0881c24f12cd21f98d0fad218d7fe6"
server_key_version: "encryptionkey@0"
I20260806 04:51:00.136114 30770 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260806 04:51:00.139429 30785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:51:00.140730 30770 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 04:51:00.140909 30770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/wal
uuid: "ae761055556141d4b2c217be396430b1"
format_stamp: "Formatted at 2026-08-06 04:51:00 on dist-test-slave-0b58"
server_key: "8ebc091e96c917bb54ca2dc7f6564fb0"
server_key_iv: "aa0881c24f12cd21f98d0fad218d7fe6"
server_key_version: "encryptionkey@0"
I20260806 04:51:00.141111 30770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:51:00.175325 30770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:51:00.179463 30770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:51:00.179738 30770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:51:00.197587 30770 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.253:33695
I20260806 04:51:00.197605 30836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.253:33695 every 8 connection(s)
I20260806 04:51:00.198920 30770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/data/info.pb
I20260806 04:51:00.202484 30837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:51:00.205610 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 30770
I20260806 04:51:00.205798 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-1/wal/instance
I20260806 04:51:00.206363 7623 external_mini_cluster.cc:1428] Setting key a4962334bce33d917ee007eddc7c659a
I20260806 04:51:00.210704 30837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:51:00 dist-test-slave-0b58 krb5kdc[30682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991860, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.253@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:51:00.233812 30767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.213761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60328 (local address 127.7.113.254:37071)
0806 04:51:00.213986 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:00.213994 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:00.215131 (+ 1137us) server_negotiation.cc:407] Connection header received
0806 04:51:00.217040 (+ 1909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:00.217048 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:00.217134 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:00.217250 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:00.218584 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.219640 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.221118 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.221528 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.221660 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.226484 (+ 4824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:51:00.226496 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:51:00.226505 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:51:00.226590 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:51:00.230600 (+ 4010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.231306 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.231314 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.231321 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.231478 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.231887 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.231895 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.231901 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.232336 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:51:00.232499 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:00.233139 (+ 640us) server_negotiation.cc:299] Negotiation successful
0806 04:51:00.233397 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 04:51:00.234436 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.214218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:37071 (local address 127.0.0.1:60328)
0806 04:51:00.214964 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.215008 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 04:51:00.216770 (+ 1762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:51:00.217422 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:51:00.217430 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:51:00.217923 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:51:00.218414 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.218429 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.219792 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.219795 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.220981 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.220993 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.221742 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.221749 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.222082 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.222905 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:51:00.222938 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:51:00.226183 (+ 3245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:51:00.230732 (+ 4549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.230746 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.230757 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.231173 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.231590 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.231593 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.231595 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.231759 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.232452 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:51:00.232457 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:51:00.232753 (+ 296us) client_negotiation.cc:769] Sending connection context
0806 04:51:00.232968 (+ 215us) client_negotiation.cc:240] Negotiation successful
0806 04:51:00.233329 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":327,"threads_started":1}
I20260806 04:51:00.236037 30837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.7.113.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.113.252@KRBTEST.COM" created.
Aug 06 04:51:00 dist-test-slave-0b58 krb5kdc[30682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991860, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.253@KRBTEST.COM for kudu/127.7.113.253@KRBTEST.COM
I20260806 04:51:00.252632 30841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.236979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42218 (local address 127.7.113.253:33695)
0806 04:51:00.237738 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:00.237748 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:00.237780 (+ 32us) server_negotiation.cc:407] Connection header received
0806 04:51:00.237841 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:00.237851 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:00.238080 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:00.238241 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:00.238982 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.240887 (+ 1905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.242025 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.242945 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.243086 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.247018 (+ 3932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:51:00.247029 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:51:00.247041 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:51:00.247069 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:51:00.249808 (+ 2739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.250580 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.250586 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.250588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.250694 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.251087 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.251090 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.251092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.251388 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:51:00.251548 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:00.251992 (+ 444us) server_negotiation.cc:299] Negotiation successful
0806 04:51:00.252345 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":108,"server-negotiator.queue_time_us":556,"thread_start_us":412,"threads_started":1}
I20260806 04:51:00.252663 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.236938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:33695 (local address 127.0.0.1:42218)
0806 04:51:00.237145 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.237167 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 04:51:00.237282 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:51:00.238236 (+ 954us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:51:00.238240 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:51:00.238669 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:51:00.238810 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.238818 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.241032 (+ 2214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.241035 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.241874 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.241885 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.243084 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.243088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.243221 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.244023 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:51:00.244057 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:51:00.246815 (+ 2758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:51:00.249934 (+ 3119us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.249941 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.249948 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.250465 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.250796 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.250803 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.250809 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.250987 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.251521 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:51:00.251528 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:51:00.251703 (+ 175us) client_negotiation.cc:769] Sending connection context
0806 04:51:00.251867 (+ 164us) client_negotiation.cc:240] Negotiation successful
0806 04:51:00.252181 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 04:51:00.255003 30837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } has no permanent_uuid. Determining permanent_uuid...
I20260806 04:51:00.256165 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.255571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:52598)
0806 04:51:00.255810 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.255936 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260806 04:51:00.256449 30786 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
I20260806 04:51:00.258054 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.257611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:52604)
0806 04:51:00.257807 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.257909 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 04:51:00.258294 30837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:38087: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.113.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.252.keytab.
Entry for principal kudu/127.7.113.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.252.keytab.
I20260806 04:51:00.283196 7623 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
/tmp/dist-test-taskTmaHtW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.252:38087
--webserver_interface=127.7.113.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.252.keytab
--principal=kudu/127.7.113.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.113.212:34687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.113.254:37071,127.7.113.253:33695,127.7.113.252:38087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 04:51:00.307583 30837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } attempt: 1
I20260806 04:51:00.308689 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.308211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:52618)
0806 04:51:00.308440 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.308543 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260806 04:51:00.309746 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.309405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:52634)
0806 04:51:00.309565 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.309641 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 04:51:00.309930 30837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:38087: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
I20260806 04:51:00.378141 30837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } attempt: 2
I20260806 04:51:00.379434 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.378951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:52640)
0806 04:51:00.379179 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.379274 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260806 04:51:00.380575 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.380210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:52652)
0806 04:51:00.380397 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.380464 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260806 04:51:00.380777 30837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:38087: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
I20260806 04:51:00.386261 30763 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } attempt: 5
Aug 06 04:51:00 dist-test-slave-0b58 krb5kdc[30682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991859, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for kudu/127.7.113.253@KRBTEST.COM
I20260806 04:51:00.400996 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.386861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:33695 (local address 127.0.0.1:42222)
0806 04:51:00.387057 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.387079 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 04:51:00.387201 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:51:00.387537 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:51:00.387540 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:51:00.387955 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:51:00.388132 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.388141 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.389533 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.389537 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.390430 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.390442 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.391397 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.391401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.391584 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.392192 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:51:00.392209 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:51:00.394743 (+ 2534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:51:00.398831 (+ 4088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.398835 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.398838 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.399173 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.399571 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.399574 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.399576 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.399689 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.400365 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:51:00.400369 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:51:00.400487 (+ 118us) client_negotiation.cc:769] Sending connection context
0806 04:51:00.400600 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 04:51:00.400779 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 04:51:00.401221 30841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.387018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42222 (local address 127.7.113.253:33695)
0806 04:51:00.387201 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:00.387207 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:00.387230 (+ 23us) server_negotiation.cc:407] Connection header received
0806 04:51:00.387314 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:00.387319 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:00.387408 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:00.387514 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:00.388302 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.389406 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.390589 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.391266 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.391394 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.394988 (+ 3594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:51:00.394996 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:51:00.395000 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:51:00.395040 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:51:00.398626 (+ 3586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.399296 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.399303 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.399306 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.399456 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.399811 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.399819 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.399823 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.400189 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:51:00.400413 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:00.400736 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 04:51:00.400946 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 04:51:00.402335 30763 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } has no permanent_uuid. Determining permanent_uuid...
I20260806 04:51:00.403379 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.403043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:52656)
0806 04:51:00.403184 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.403263 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260806 04:51:00.404232 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.403929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:52660)
0806 04:51:00.404070 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.404135 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 04:51:00.404466 30763 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:38087: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
I20260806 04:51:00.455682 30763 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } attempt: 1
I20260806 04:51:00.456852 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.456398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:52670)
0806 04:51:00.456584 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.456680 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260806 04:51:00.457798 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.457477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:52680)
0806 04:51:00.457620 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.457692 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 04:51:00.458002 30763 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:38087: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
I20260806 04:51:00.471983 30837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } attempt: 3
I20260806 04:51:00.473209 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.472750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:52686)
0806 04:51:00.472975 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.473060 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260806 04:51:00.474328 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.473913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:52688)
0806 04:51:00.474140 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.474212 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260806 04:51:00.474540 30837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:38087: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
I20260806 04:51:00.526206 30763 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } attempt: 2
I20260806 04:51:00.527354 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.526881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:52702)
0806 04:51:00.527075 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.527195 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260806 04:51:00.528368 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.527980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:52710)
0806 04:51:00.528122 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.528199 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 04:51:00.528568 30763 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:38087: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
I20260806 04:51:00.617741 30837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } attempt: 4
I20260806 04:51:00.618882 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.618400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:54174)
0806 04:51:00.618646 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.618734 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 04:51:00.619925 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.619587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:54186)
0806 04:51:00.619750 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.619824 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260806 04:51:00.620139 30837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:38087: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
W20260806 04:51:00.622834 30844 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 04:51:00.623193 30844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 04:51:00.623318 30844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 04:51:00.623457 30844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 04:51:00.630762 30844 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 04:51:00.630883 30844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 04:51:00.631006 30844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 04:51:00.631093 30844 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 04:51:00.631203 30844 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 04:51:00.634768 30763 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } attempt: 3
I20260806 04:51:00.635813 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.635359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:54198)
0806 04:51:00.635585 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.635664 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 04:51:00.636807 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.636450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:54214)
0806 04:51:00.636646 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.636712 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260806 04:51:00.637010 30763 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.113.252:38087: Network error: Client connection negotiation failed: client connection to 127.7.113.252:38087: connect: Connection refused (error 111)
I20260806 04:51:00.641506 30844 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.113.212:34687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.113.254:37071,127.7.113.253:33695,127.7.113.252:38087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/krb5kdc/kudu_127.7.113.252.keytab
--principal=kudu/127.7.113.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.113.252:38087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.113.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 03:56:12 UTC on ccycloud.quasar-guijbm.root.comops.site
build id 4569618
ASAN enabled
I20260806 04:51:00.642845 30844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 04:51:00.644230 30844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 04:51:00.656802 30852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:51:00.656884 30849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 04:51:00.656889 30850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 04:51:00.657697 30844 server_base.cc:1034] running on GCE node
I20260806 04:51:00.658633 30844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 04:51:00.661270 30844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 04:51:00.662515 30844 hybrid_clock.cc:648] HybridClock initialized: now 1785991860662449 us; error 42 us; skew 500 ppm
I20260806 04:51:00.662868 30844 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 04:51:00 dist-test-slave-0b58 krb5kdc[30682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991860, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 04:51:00.665997 30844 init.cc:377] Logged in from keytab as kudu/127.7.113.252@KRBTEST.COM (short username kudu)
I20260806 04:51:00.667493 30844 webserver.cc:460] Webserver started at http://127.7.113.252:45925/ using document root <none> and password file <none>
I20260806 04:51:00.668123 30844 fs_manager.cc:359] Metadata directory not provided
I20260806 04:51:00.668213 30844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 04:51:00.668576 30844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 04:51:00.671411 30844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/data/instance:
uuid: "2836b84e79d34f9d96d6ee7ae263a8d9"
format_stamp: "Formatted at 2026-08-06 04:51:00 on dist-test-slave-0b58"
server_key: "f93eb6e7f650d47dcb2a851c20f98c2e"
server_key_iv: "caf01675b8f8f5a1693466f6c2cda821"
server_key_version: "encryptionkey@0"
I20260806 04:51:00.672219 30844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/wal/instance:
uuid: "2836b84e79d34f9d96d6ee7ae263a8d9"
format_stamp: "Formatted at 2026-08-06 04:51:00 on dist-test-slave-0b58"
server_key: "f93eb6e7f650d47dcb2a851c20f98c2e"
server_key_iv: "caf01675b8f8f5a1693466f6c2cda821"
server_key_version: "encryptionkey@0"
I20260806 04:51:00.677335 30844 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 04:51:00.681207 30859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 04:51:00.682705 30844 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 04:51:00.682884 30844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/data,/tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/wal
uuid: "2836b84e79d34f9d96d6ee7ae263a8d9"
format_stamp: "Formatted at 2026-08-06 04:51:00 on dist-test-slave-0b58"
server_key: "f93eb6e7f650d47dcb2a851c20f98c2e"
server_key_iv: "caf01675b8f8f5a1693466f6c2cda821"
server_key_version: "encryptionkey@0"
I20260806 04:51:00.683120 30844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 04:51:00.705353 30844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 04:51:00.709190 30844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 04:51:00.709429 30844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 04:51:00.727697 30844 rpc_server.cc:307] RPC server started. Bound to: 127.7.113.252:38087
I20260806 04:51:00.727715 30912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.113.252:38087 every 8 connection(s)
I20260806 04:51:00.729094 30844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/data/info.pb
I20260806 04:51:00.733134 30913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 04:51:00.733117 7623 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu as pid 30844
I20260806 04:51:00.733314 7623 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTmaHtW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785991498713577-7623-0/minicluster-data/master-2/wal/instance
I20260806 04:51:00.733870 7623 external_mini_cluster.cc:1428] Setting key d3149ccddc7afe57e100af360ad3a604
I20260806 04:51:00.742898 30913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:51:00 dist-test-slave-0b58 krb5kdc[30682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.252@KRBTEST.COM
Aug 06 04:51:00 dist-test-slave-0b58 krb5kdc[30682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991860, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.252@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
I20260806 04:51:00.757968 30916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.735700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54228 (local address 127.7.113.252:38087)
0806 04:51:00.736564 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:00.736575 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:00.736615 (+ 40us) server_negotiation.cc:407] Connection header received
0806 04:51:00.738238 (+ 1623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:00.738259 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:00.738652 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:00.738980 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:00.740777 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.742021 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.743853 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.744697 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.744887 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.749587 (+ 4700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:51:00.749600 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:51:00.749617 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:51:00.749668 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:51:00.752957 (+ 3289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.753757 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.753763 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.753769 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.753942 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.754866 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.754870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.754872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.755418 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:51:00.755720 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:00.756113 (+ 393us) server_negotiation.cc:299] Negotiation successful
0806 04:51:00.756571 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":402,"threads_started":1}
I20260806 04:51:00.762002 30917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.745968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33176 (local address 127.7.113.254:37071)
0806 04:51:00.746511 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:00.746518 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:00.746949 (+ 431us) server_negotiation.cc:407] Connection header received
0806 04:51:00.747165 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:00.747170 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:00.747245 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:00.747358 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:00.748724 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.749518 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.751166 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.751813 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.751967 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.755374 (+ 3407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:51:00.755381 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:51:00.755385 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:51:00.755424 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:51:00.758972 (+ 3548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.759886 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.759890 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.759892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.760016 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.760459 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.760466 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.760471 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.760802 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:51:00.760979 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:00.761519 (+ 540us) server_negotiation.cc:299] Negotiation successful
0806 04:51:00.761713 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":275,"threads_started":1}
I20260806 04:51:00.762404 30918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.746051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.254:37071 (local address 127.0.0.1:33176)
0806 04:51:00.746818 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.746860 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 04:51:00.747036 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:51:00.747416 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:51:00.747423 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:51:00.748173 (+ 750us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:51:00.748563 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.748578 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.749694 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.749698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.751016 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.751028 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.752003 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.752007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.752135 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.752786 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:51:00.752806 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:51:00.755180 (+ 2374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:51:00.759101 (+ 3921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.759110 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.759116 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.759767 (+ 651us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.760126 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.760131 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.760134 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.760334 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.760951 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:51:00.760958 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:51:00.761178 (+ 220us) client_negotiation.cc:769] Sending connection context
0806 04:51:00.761386 (+ 208us) client_negotiation.cc:240] Negotiation successful
0806 04:51:00.761797 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":436,"threads_started":1}
I20260806 04:51:00.764200 30913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:51:00 dist-test-slave-0b58 krb5kdc[30682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.254@KRBTEST.COM
Aug 06 04:51:00 dist-test-slave-0b58 krb5kdc[30682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991860, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.252@KRBTEST.COM for kudu/127.7.113.253@KRBTEST.COM
I20260806 04:51:00.777076 30917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.761213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33188 (local address 127.7.113.254:37071)
0806 04:51:00.762313 (+ 1100us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:00.762319 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:00.762337 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:51:00.762380 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:00.762383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:00.762453 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:00.762572 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:00.764205 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.765394 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.766642 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.767063 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.767197 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.771498 (+ 4301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:51:00.771505 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:51:00.771510 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:51:00.771547 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:51:00.774191 (+ 2644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.774959 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.774962 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.774964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.775070 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.775464 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.775468 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.775471 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.775822 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:51:00.776116 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:00.776493 (+ 377us) server_negotiation.cc:299] Negotiation successful
0806 04:51:00.776735 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1007,"thread_start_us":3198,"threads_started":1}
I20260806 04:51:00.778425 30918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.765056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.253:33695 (local address 127.0.0.1:34562)
0806 04:51:00.765319 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.765333 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 04:51:00.765451 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:51:00.765778 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:51:00.765783 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:51:00.766153 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:51:00.766280 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.766287 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.767222 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.767229 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.768315 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.768330 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.769024 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.769030 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.769198 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.769722 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:51:00.769737 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:51:00.771918 (+ 2181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:51:00.775471 (+ 3553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.775475 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.775480 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.775969 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.776397 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.776402 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.776405 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.776569 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.777167 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:51:00.777172 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:51:00.777669 (+ 497us) client_negotiation.cc:769] Sending connection context
0806 04:51:00.777813 (+ 144us) client_negotiation.cc:240] Negotiation successful
0806 04:51:00.778084 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182}
I20260806 04:51:00.778488 30841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.765057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34562 (local address 127.7.113.253:33695)
0806 04:51:00.765217 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:00.765221 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:00.765418 (+ 197us) server_negotiation.cc:407] Connection header received
0806 04:51:00.765577 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:00.765582 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:00.765658 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:00.765757 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:00.766430 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.767089 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.768458 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.768872 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.769004 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.772143 (+ 3139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:51:00.772151 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:51:00.772157 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:51:00.772199 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:51:00.775328 (+ 3129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.776084 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.776089 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.776093 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.776287 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.776764 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.776769 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.776772 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.777042 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:51:00.777192 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:00.777910 (+ 718us) server_negotiation.cc:299] Negotiation successful
0806 04:51:00.778115 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 04:51:00.779453 30913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 04:51:00 dist-test-slave-0b58 krb5kdc[30682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991860, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.252@KRBTEST.COM for kudu/127.7.113.252@KRBTEST.COM
Aug 06 04:51:00 dist-test-slave-0b58 krb5kdc[30682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.113.253@KRBTEST.COM
I20260806 04:51:00.793466 30918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.780317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:54238)
0806 04:51:00.780518 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.780531 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 04:51:00.780650 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:51:00.780953 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:51:00.780956 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:51:00.781265 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:51:00.781395 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.781402 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.782424 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.782429 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.783536 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.783548 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.784453 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.784459 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.784707 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.785196 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:51:00.785219 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:51:00.787592 (+ 2373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:51:00.790933 (+ 3341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.790939 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.790944 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.791420 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.791763 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.791769 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.791775 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.791946 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.792568 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:51:00.792572 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:51:00.792692 (+ 120us) client_negotiation.cc:769] Sending connection context
0806 04:51:00.792801 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 04:51:00.793113 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128}
I20260806 04:51:00.793757 30916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.780239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54238 (local address 127.7.113.252:38087)
0806 04:51:00.780420 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:00.780426 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:00.780594 (+ 168us) server_negotiation.cc:407] Connection header received
0806 04:51:00.780752 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:00.780757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:00.780819 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:00.780909 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:00.781526 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.782285 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.783707 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.784259 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.784398 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.787758 (+ 3360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:51:00.787765 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:51:00.787771 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:51:00.787812 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:51:00.790801 (+ 2989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.791537 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.791541 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.791543 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.791653 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.792046 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.792049 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.792051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.792454 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:51:00.792604 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:00.792931 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 04:51:00.793321 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":93,"server-negotiator.queue_time_us":70}
I20260806 04:51:00.795154 30841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.778980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34576 (local address 127.7.113.253:33695)
0806 04:51:00.779165 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:00.779170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:00.779186 (+ 16us) server_negotiation.cc:407] Connection header received
0806 04:51:00.779234 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:00.779241 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:00.779316 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:00.779412 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:00.780834 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.781660 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.783108 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.783529 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.783617 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.788844 (+ 5227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:51:00.788851 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:51:00.788856 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:51:00.788894 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:51:00.792057 (+ 3163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.792966 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.792970 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.792973 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.793129 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.793577 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.793585 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.793736 (+ 151us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.794094 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:51:00.794393 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:00.794602 (+ 209us) server_negotiation.cc:299] Negotiation successful
0806 04:51:00.794870 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 04:51:00.799316 30913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9: Bootstrap starting.
I20260806 04:51:00.799849 7623 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 04:51:00.802600 30913 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9: Neither blocks nor log segments found. Creating new log.
I20260806 04:51:00.803617 30913 log.cc:824] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9: Log is configured to *not* fsync() on all Append() calls
I20260806 04:51:00.802152 30738 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "0a530de2e7fc485abc5d8f41c7353ef2"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33188
I20260806 04:51:00.806391 30913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9: No bootstrap required, opened a new log
I20260806 04:51:00.813278 30913 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } }
I20260806 04:51:00.813596 30913 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2836b84e79d34f9d96d6ee7ae263a8d9, State: Initialized, Role: FOLLOWER
I20260806 04:51:00.814019 30913 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } }
I20260806 04:51:00.814214 30763 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } attempt: 4
I20260806 04:51:00.815071 30921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } } }
I20260806 04:51:00.815490 30921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:51:00.816318 30913 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9 [sys.catalog]: configured and running, proceeding with master startup.
Aug 06 04:51:00 dist-test-slave-0b58 krb5kdc[30682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991859, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.254@KRBTEST.COM for kudu/127.7.113.252@KRBTEST.COM
W20260806 04:51:00.829196 30932 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 04:51:00.829319 30932 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 04:51:00.831904 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.814858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:54244)
0806 04:51:00.815136 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.815158 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 04:51:00.815287 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:51:00.815839 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:51:00.815844 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:51:00.816373 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:51:00.816608 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.816623 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.818199 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.818206 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.819685 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.819702 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.820823 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.820829 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.821047 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.821711 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:51:00.821739 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:51:00.824380 (+ 2641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:51:00.828986 (+ 4606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.828992 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.828996 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.829519 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.829983 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.829988 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.829992 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.830143 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.830826 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:51:00.830831 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:51:00.831048 (+ 217us) client_negotiation.cc:769] Sending connection context
0806 04:51:00.831198 (+ 150us) client_negotiation.cc:240] Negotiation successful
0806 04:51:00.831498 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145}
I20260806 04:51:00.832401 30916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.814904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54244 (local address 127.7.113.252:38087)
0806 04:51:00.815090 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:00.815095 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:00.815240 (+ 145us) server_negotiation.cc:407] Connection header received
0806 04:51:00.815437 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:00.815442 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:00.815524 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:00.815623 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:00.816793 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.818037 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.819822 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.820650 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.820808 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.824613 (+ 3805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:51:00.824621 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:51:00.824626 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:51:00.824662 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:51:00.828824 (+ 4162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.829691 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.829696 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.829699 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.829873 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.830257 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.830267 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.830272 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.830683 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:51:00.830856 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:00.831382 (+ 526us) server_negotiation.cc:299] Negotiation successful
0806 04:51:00.831777 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 04:51:00.826475 30844 master_runner.cc:186] Error getting master registration for 127.7.113.254:37071: OK, instance_id { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" instance_seqno: 1785991859674116 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 04:51:00.838560 30844 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 04:51:00.838781 30763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2: Bootstrap starting.
I20260806 04:51:00.841955 30763 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2: Neither blocks nor log segments found. Creating new log.
I20260806 04:51:00.842962 30763 log.cc:824] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2: Log is configured to *not* fsync() on all Append() calls
I20260806 04:51:00.846462 30763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2: No bootstrap required, opened a new log
I20260806 04:51:00.853001 30763 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } }
I20260806 04:51:00.853325 30763 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a530de2e7fc485abc5d8f41c7353ef2, State: Initialized, Role: FOLLOWER
I20260806 04:51:00.853767 30763 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } }
I20260806 04:51:00.854707 30935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } } }
I20260806 04:51:00.855098 30935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:51:00.855830 30763 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:51:00.855983 30738 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 04:51:00.856235 30738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:51:00.859994 30738 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } }
I20260806 04:51:00.866183 30738 leader_election.cc:288] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [CANDIDATE]: Term 1 election: Requested vote from peers ae761055556141d4b2c217be396430b1 (127.7.113.253:33695), 2836b84e79d34f9d96d6ee7ae263a8d9 (127.7.113.252:38087)
I20260806 04:51:00.867046 30888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9"
I20260806 04:51:00.867538 30888 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:51:00.871043 30888 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a530de2e7fc485abc5d8f41c7353ef2 in term 1.
I20260806 04:51:00.872678 30712 leader_election.cc:302] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a530de2e7fc485abc5d8f41c7353ef2, 2836b84e79d34f9d96d6ee7ae263a8d9; no voters:
W20260806 04:51:00.872829 30946 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 04:51:00.872954 30946 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 04:51:00.873188 30935 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 04:51:00.879431 30935 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [term 1 LEADER]: Becoming Leader. State: Replica: 0a530de2e7fc485abc5d8f41c7353ef2, State: Running, Role: LEADER
I20260806 04:51:00.865785 30695 master_runner.cc:186] Error getting master registration for 127.7.113.253:33695: OK, instance_id { permanent_uuid: "ae761055556141d4b2c217be396430b1" instance_seqno: 1785991860192585 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 04:51:00.880548 30695 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 04:51:00.880136 30935 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } }
I20260806 04:51:00.883656 30935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a530de2e7fc485abc5d8f41c7353ef2. Latest consensus state: current_term: 1 leader_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } } }
I20260806 04:51:00.884035 30935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [sys.catalog]: This master's current role is: LEADER
I20260806 04:51:00.897934 30952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 04:51:00.902874 30952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260806 04:51:00.913580 30717 tablet.cc:2369] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:51:00.915640 30888 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9 [term 1 FOLLOWER]: Refusing update from remote peer 0a530de2e7fc485abc5d8f41c7353ef2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:51:00.916627 30935 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:51:00.919330 30837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } attempt: 5
Aug 06 04:51:00 dist-test-slave-0b58 krb5kdc[30682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785991860, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.113.253@KRBTEST.COM for kudu/127.7.113.252@KRBTEST.COM
I20260806 04:51:00.949787 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.919860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.113.252:38087 (local address 127.0.0.1:54254)
0806 04:51:00.920415 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0806 04:51:00.920436 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 04:51:00.920552 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 04:51:00.929470 (+ 8918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 04:51:00.929475 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 04:51:00.929989 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0806 04:51:00.930177 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.930188 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.931635 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.931640 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.933840 (+ 2200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 04:51:00.933855 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.935519 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.935528 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 04:51:00.935804 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.936664 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 04:51:00.936715 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0806 04:51:00.940245 (+ 3530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 04:51:00.945999 (+ 5754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.946007 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.946014 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.946775 (+ 761us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.947337 (+ 562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 04:51:00.947344 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 04:51:00.947351 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 04:51:00.947548 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 04:51:00.948429 (+ 881us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 04:51:00.948436 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 04:51:00.948641 (+ 205us) client_negotiation.cc:769] Sending connection context
0806 04:51:00.948828 (+ 187us) client_negotiation.cc:240] Negotiation successful
0806 04:51:00.949192 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"mutex_wait_us":673}
I20260806 04:51:00.951128 30916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.920782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54254 (local address 127.7.113.252:38087)
0806 04:51:00.921675 (+ 893us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:00.921681 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:00.921699 (+ 18us) server_negotiation.cc:407] Connection header received
0806 04:51:00.921772 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:00.921777 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:00.929157 (+ 7380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:00.929264 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:00.930355 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.931437 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.934034 (+ 2597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.935094 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.935249 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.940531 (+ 5282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:51:00.940541 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:51:00.940548 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:51:00.940599 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:51:00.945809 (+ 5210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.946955 (+ 1146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.946968 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.946974 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.947164 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.947705 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.947713 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.947719 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.948164 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:51:00.948351 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:00.950340 (+ 1989us) server_negotiation.cc:299] Negotiation successful
0806 04:51:00.950627 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760}
I20260806 04:51:00.959124 30837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1: Bootstrap starting.
W20260806 04:51:00.961346 30866 tablet.cc:2369] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 04:51:00.963408 30837 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1: Neither blocks nor log segments found. Creating new log.
I20260806 04:51:00.965134 30837 log.cc:824] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1: Log is configured to *not* fsync() on all Append() calls
I20260806 04:51:00.982947 30917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.920693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33196 (local address 127.7.113.254:37071)
0806 04:51:00.920865 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:00.920871 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:00.958517 (+ 37646us) server_negotiation.cc:407] Connection header received
0806 04:51:00.959459 (+ 942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:00.959465 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:00.959558 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:00.959659 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:00.961825 (+ 2166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.962950 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.966547 (+ 3597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.967304 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.967420 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.973991 (+ 6571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:51:00.974000 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:51:00.974007 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:51:00.974070 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:51:00.977931 (+ 3861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.979515 (+ 1584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.979523 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.979527 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.979705 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.980601 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.980607 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.980610 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.980989 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:51:00.981258 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:00.982260 (+ 1002us) server_negotiation.cc:299] Negotiation successful
0806 04:51:00.982495 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 04:51:00.987612 30921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a530de2e7fc485abc5d8f41c7353ef2. Latest consensus state: current_term: 1 leader_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } } }
I20260806 04:51:00.987951 30921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:51:00.990003 30955 mvcc.cc:205] Tried to move back new op lower bound from 7315422662295240704 to 7315422662172979200. Current Snapshot: MvccSnapshot[applied={T|T < 7315422662295240704}]
I20260806 04:51:00.991866 30837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1: No bootstrap required, opened a new log
I20260806 04:51:00.997180 30841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.912024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34588 (local address 127.7.113.253:33695)
0806 04:51:00.912239 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:00.912248 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:00.922025 (+ 9777us) server_negotiation.cc:407] Connection header received
0806 04:51:00.922340 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:00.922349 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:00.922449 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:00.922537 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:00.925711 (+ 3174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.927244 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.932341 (+ 5097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.933364 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.933488 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.977913 (+ 44425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:51:00.977920 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:51:00.977925 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:51:00.977967 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:51:00.981703 (+ 3736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.983895 (+ 2192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.983901 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.983904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.984060 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:00.988488 (+ 4428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:00.988495 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:00.988499 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:00.988901 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:51:00.989123 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:00.996531 (+ 7408us) server_negotiation.cc:299] Negotiation successful
0806 04:51:00.996764 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":43}
I20260806 04:51:01.010135 30916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:00.922068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54258 (local address 127.7.113.252:38087)
0806 04:51:00.963713 (+ 41645us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:00.963719 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:00.964303 (+ 584us) server_negotiation.cc:407] Connection header received
0806 04:51:00.965378 (+ 1075us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:00.965386 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:00.965509 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:00.965627 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:00.967988 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.969254 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.984572 (+ 15318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:00.985218 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:00.985317 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:00.999928 (+ 14611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 04:51:00.999937 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 04:51:00.999943 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 04:51:00.999985 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 04:51:01.003827 (+ 3842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:01.004741 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:01.004748 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:01.004751 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:01.005141 (+ 390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 04:51:01.006233 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 04:51:01.006241 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 04:51:01.006245 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 04:51:01.007019 (+ 774us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 04:51:01.007526 (+ 507us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:01.008735 (+ 1209us) server_negotiation.cc:299] Negotiation successful
0806 04:51:01.009220 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41515,"thread_start_us":61130,"threads_started":1}
I20260806 04:51:01.011806 30837 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } }
I20260806 04:51:01.012246 30837 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae761055556141d4b2c217be396430b1, State: Initialized, Role: FOLLOWER
I20260806 04:51:01.012523 30935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } } }
I20260806 04:51:01.012791 30935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [sys.catalog]: This master's current role is: LEADER
I20260806 04:51:01.012809 30837 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } }
I20260806 04:51:01.014096 30965 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } } }
I20260806 04:51:01.014894 30965 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:51:01.016986 30952 catalog_manager.cc:1347] Generated new cluster ID: 31aac3e4d6fd4dd1845f25c3f9ce8e7b
I20260806 04:51:01.017100 30952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 04:51:01.017264 30921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } } }
I20260806 04:51:01.017521 30921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:51:01.018098 30837 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 04:51:01.022992 30812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ae761055556141d4b2c217be396430b1"
I20260806 04:51:01.023582 30812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 04:51:01.028239 30812 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a530de2e7fc485abc5d8f41c7353ef2 in term 1.
I20260806 04:51:01.036763 30811 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1 [term 1 FOLLOWER]: Refusing update from remote peer 0a530de2e7fc485abc5d8f41c7353ef2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 04:51:01.039129 30948 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 04:51:01.076398 30965 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a530de2e7fc485abc5d8f41c7353ef2. Latest consensus state: current_term: 1 leader_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } } }
I20260806 04:51:01.076757 30965 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:51:01.077996 30975 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } } }
I20260806 04:51:01.078480 30975 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 04:51:01.079668 30948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a530de2e7fc485abc5d8f41c7353ef2" member_type: VOTER last_known_addr { host: "127.7.113.254" port: 37071 } } peers { permanent_uuid: "ae761055556141d4b2c217be396430b1" member_type: VOTER last_known_addr { host: "127.7.113.253" port: 33695 } } peers { permanent_uuid: "2836b84e79d34f9d96d6ee7ae263a8d9" member_type: VOTER last_known_addr { host: "127.7.113.252" port: 38087 } } }
I20260806 04:51:01.080021 30948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2 [sys.catalog]: This master's current role is: LEADER
I20260806 04:51:01.085783 30952 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 04:51:01.088815 30952 catalog_manager.cc:1504] Loading token signing keys...
I20260806 04:51:01.106197 30952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a530de2e7fc485abc5d8f41c7353ef2: Generated new TSK 0
I20260806 04:51:01.107895 30952 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 04:51:01.109428 30980 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260806 04:51:01.242638 30916 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:51:01.232005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54274 (local address 127.7.113.252:38087)
0806 04:51:01.232210 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:01.232219 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:01.240808 (+ 8589us) server_negotiation.cc:407] Connection header received
0806 04:51:01.241046 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:01.241054 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:01.241141 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:01.241215 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:01.242362 (+ 1147us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54274: BlockingRecv error: recv got EOF from 127.0.0.1:54274 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260806 04:51:01.243798 30841 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:51:01.230614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34592 (local address 127.7.113.253:33695)
0806 04:51:01.231066 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:01.231074 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:01.240067 (+ 8993us) server_negotiation.cc:407] Connection header received
0806 04:51:01.240900 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:01.240906 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:01.241003 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:01.241078 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:01.243561 (+ 2483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34592: BlockingRecv error: recv got EOF from 127.0.0.1:34592 (error 108)
Metrics: {"server-negotiator.queue_time_us":293}
W20260806 04:51:01.246275 30917 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:51:01.230825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33206 (local address 127.7.113.254:37071)
0806 04:51:01.231224 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:01.231230 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:01.243854 (+ 12624us) server_negotiation.cc:407] Connection header received
0806 04:51:01.244373 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:01.244402 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:01.244492 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:01.244570 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:01.246017 (+ 1447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33206: BlockingRecv error: recv got EOF from 127.0.0.1:33206 (error 108)
Metrics: {"server-negotiator.queue_time_us":279}
W20260806 04:51:01.258693 30841 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:51:01.256249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34604 (local address 127.7.113.253:33695)
0806 04:51:01.256478 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:01.256485 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:01.256955 (+ 470us) server_negotiation.cc:407] Connection header received
0806 04:51:01.257333 (+ 378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:01.257340 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:01.257476 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:01.257599 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:01.258394 (+ 795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34604: BlockingRecv error: recv got EOF from 127.0.0.1:34604 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260806 04:51:01.274497 30841 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:51:01.266911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34608 (local address 127.7.113.253:33695)
0806 04:51:01.267078 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:01.267084 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:01.272898 (+ 5814us) server_negotiation.cc:407] Connection header received
0806 04:51:01.273109 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:01.273115 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:01.273219 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:01.273352 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:01.274272 (+ 920us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34608: BlockingRecv error: recv got EOF from 127.0.0.1:34608 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 04:51:01.284205 30841 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:51:01.281954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34624 (local address 127.7.113.253:33695)
0806 04:51:01.282145 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:01.282150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:01.282718 (+ 568us) server_negotiation.cc:407] Connection header received
0806 04:51:01.282928 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:01.282933 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:01.283029 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:01.283148 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:01.283959 (+ 811us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34624: BlockingRecv error: recv got EOF from 127.0.0.1:34624 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260806 04:51:01.297691 30841 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:51:01.295709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34638 (local address 127.7.113.253:33695)
0806 04:51:01.295929 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:01.295935 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:01.295957 (+ 22us) server_negotiation.cc:407] Connection header received
0806 04:51:01.296171 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:01.296177 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:01.296300 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:01.296393 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:01.297440 (+ 1047us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34638: BlockingRecv error: recv got EOF from 127.0.0.1:34638 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
W20260806 04:51:01.311762 30841 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:51:01.309589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34652 (local address 127.7.113.253:33695)
0806 04:51:01.309761 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:01.309767 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:01.310296 (+ 529us) server_negotiation.cc:407] Connection header received
0806 04:51:01.310487 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:01.310493 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:01.310584 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:01.310695 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:01.311538 (+ 843us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34652: BlockingRecv error: recv got EOF from 127.0.0.1:34652 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 04:51:01.334334 30841 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:51:01.331883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34658 (local address 127.7.113.253:33695)
0806 04:51:01.332096 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:01.332102 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:01.332700 (+ 598us) server_negotiation.cc:407] Connection header received
0806 04:51:01.332909 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:01.332915 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:01.333028 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:01.333150 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:01.334091 (+ 941us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34658: BlockingRecv error: recv got EOF from 127.0.0.1:34658 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 04:51:01.376773 30841 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:51:01.374206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34664 (local address 127.7.113.253:33695)
0806 04:51:01.374402 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:01.374408 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:01.374922 (+ 514us) server_negotiation.cc:407] Connection header received
0806 04:51:01.375298 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:01.375307 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:01.375413 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:01.375538 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:01.376475 (+ 937us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34664: BlockingRecv error: recv got EOF from 127.0.0.1:34664 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260806 04:51:01.446241 30841 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:51:01.444181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34672 (local address 127.7.113.253:33695)
0806 04:51:01.444394 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:01.444398 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:01.444840 (+ 442us) server_negotiation.cc:407] Connection header received
0806 04:51:01.445005 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:01.445010 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:01.445087 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:01.445290 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:01.446026 (+ 736us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34672: BlockingRecv error: recv got EOF from 127.0.0.1:34672 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260806 04:51:01.580477 30841 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:51:01.578425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34676 (local address 127.7.113.253:33695)
0806 04:51:01.578677 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:01.578685 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:01.578975 (+ 290us) server_negotiation.cc:407] Connection header received
0806 04:51:01.579199 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:01.579211 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:01.579298 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:01.579414 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:01.580147 (+ 733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34676: BlockingRecv error: recv got EOF from 127.0.0.1:34676 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 04:51:01.831219 30932 catalog_manager.cc:1259] Loaded cluster ID: 31aac3e4d6fd4dd1845f25c3f9ce8e7b
I20260806 04:51:01.831336 30932 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9: loading cluster ID for follower catalog manager: success
I20260806 04:51:01.833847 30932 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9: acquiring CA information for follower catalog manager: success
I20260806 04:51:01.835534 30932 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2836b84e79d34f9d96d6ee7ae263a8d9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 04:51:01.841954 30841 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 04:51:01.840115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34692 (local address 127.7.113.253:33695)
0806 04:51:01.840363 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:01.840370 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:01.840526 (+ 156us) server_negotiation.cc:407] Connection header received
0806 04:51:01.840751 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:01.840757 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:01.840838 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:01.840949 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 04:51:01.841737 (+ 788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34692: BlockingRecv error: recv got EOF from 127.0.0.1:34692 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 04:51:02.113499 30980 catalog_manager.cc:1259] Loaded cluster ID: 31aac3e4d6fd4dd1845f25c3f9ce8e7b
I20260806 04:51:02.113663 30980 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1: loading cluster ID for follower catalog manager: success
I20260806 04:51:02.116242 30980 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1: acquiring CA information for follower catalog manager: success
I20260806 04:51:02.118330 30980 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ae761055556141d4b2c217be396430b1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 04:51:02.368101 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:02.360564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34706 (local address 127.7.113.253:33695)
0806 04:51:02.361421 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:02.361429 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:02.361450 (+ 21us) server_negotiation.cc:407] Connection header received
0806 04:51:02.361516 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:02.361520 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:02.361661 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:02.361797 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:51:02.362348 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:02.363713 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:02.365126 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:02.365883 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:02.366033 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:02.366544 (+ 511us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:51:02.367410 (+ 866us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:51:02.367578 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:02.367642 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 04:51:02.367729 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":708,"thread_start_us":545,"threads_started":1}
I20260806 04:51:02.380119 31053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:02.374293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54286 (local address 127.7.113.252:38087)
0806 04:51:02.374908 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:02.374916 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:02.374936 (+ 20us) server_negotiation.cc:407] Connection header received
0806 04:51:02.375046 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:02.375050 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:02.375201 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:02.375380 (+ 179us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:51:02.375753 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:02.376564 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:02.377929 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:02.378328 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:02.378471 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:02.378971 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:51:02.379491 (+ 520us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:51:02.379652 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:02.379735 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 04:51:02.379818 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":375,"threads_started":1}
I20260806 04:51:02.396009 31053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:02.387218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54288 (local address 127.7.113.252:38087)
0806 04:51:02.387384 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:02.387393 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:02.388110 (+ 717us) server_negotiation.cc:407] Connection header received
0806 04:51:02.389224 (+ 1114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:02.389233 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:02.389360 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:02.389465 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:51:02.390387 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:02.391623 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:02.393821 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:02.394447 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:02.394541 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:02.395223 (+ 682us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:51:02.395349 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:51:02.395415 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:02.395630 (+ 215us) server_negotiation.cc:299] Negotiation successful
0806 04:51:02.395705 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 04:51:02.399106 31061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:02.386702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33222 (local address 127.7.113.254:37071)
0806 04:51:02.388637 (+ 1935us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:02.388643 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:02.391565 (+ 2922us) server_negotiation.cc:407] Connection header received
0806 04:51:02.391689 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:02.391696 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:02.391928 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:02.392100 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:51:02.393099 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:02.394173 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:02.396204 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:02.396856 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:02.396971 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:02.397659 (+ 688us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:51:02.398090 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:51:02.398204 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:02.398687 (+ 483us) server_negotiation.cc:299] Negotiation successful
0806 04:51:02.398770 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1798,"thread_start_us":1696,"threads_started":1}
I20260806 04:51:02.403573 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 30695
I20260806 04:51:02.404610 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 04:51:02.386909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34720 (local address 127.7.113.253:33695)
0806 04:51:02.392117 (+ 5208us) server_negotiation.cc:206] Beginning negotiation
0806 04:51:02.392123 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 04:51:02.398323 (+ 6200us) server_negotiation.cc:407] Connection header received
0806 04:51:02.398410 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 04:51:02.398415 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 04:51:02.398504 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 04:51:02.398596 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 04:51:02.399421 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:02.400390 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:02.402391 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 04:51:02.402835 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 04:51:02.402910 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 04:51:02.403760 (+ 850us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 04:51:02.403892 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 04:51:02.403981 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 04:51:02.404168 (+ 187us) server_negotiation.cc:299] Negotiation successful
0806 04:51:02.404246 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5063}
I20260806 04:51:02.404727 30758 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:51:02.537467 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 30695
W20260806 04:51:02.560654 30787 connection.cc:535] server connection from 127.0.0.1:42222 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 04:51:02.561072 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 30770
I20260806 04:51:02.562125 30832 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:51:02.667996 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 30770
I20260806 04:51:02.690016 7623 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu pid 30844
I20260806 04:51:02.691108 30908 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 04:51:02.795274 7623 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTmaHtW/build/asan/bin/kudu with pid 30844
2026-08-06T04:51:02Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5003 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9956 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (364034 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST